Welcome to AMP-SCZ Lochness’s documentation!

Lochness is a data management tool designed to periodically poll and download data from various data archives into a local directory. This is often referred to as building a “data lake” (hence the name). This repository is a fork from harvard-nrg lochness, updated and maintained by DPACC for U24 project.

• Quick start
  • Installation
  • Setup from a template
  • Run sync.py
  • Example PHOENIX-BIDS structure
  • Manual Setup
  • Basic usage
• Lochness sync.py function in detail
  • 1. Loads configuration file
  • 2. Automatically create and update metadata for each site (study)
  • 3. For each subject available in metadata.csv
  • 4. Transfer selected data to s3 bucket
• Data sources
  • Beiwe
  • REDCap
  • RPMS
  • XNAT
  • Dropbox
  • Box
  • Mediaflux
  • Mindlamp
  • DaRIS
• The PHOENIX filesystem
  • GENERAL and PROTECTED folders
  • Study folders
  • Subject folders
  • Data type folders
  • Raw and processed folders
  • Product folders (optional)
  • Raw file integrity
  • Raw file naming convention
  • Metadata files
• Configuration file
  • keyring_file
  • phoenix_root
  • stdout
  • stderr
  • poll_interval
  • pii_table
  • lochness_sync_history_csv
  • beiwe
  • dropbox
  • box
  • mediaflux
  • redcap
  • admins
  • notify
  • sender
  • ssh_user
  • ssh_host

Indices and tables

• Index

• Module Index

• Search Page