DFN observatory data folders and files structure

Each DFN observatory has several disks with partitions for data. The operating system and buffer for several nights of data is on a fast and low power SSD drive, typically 500GB size. Most of it's size is allocated to data0 partition. This one is mounted as /data0 in the embedded PC OS filesystem. Last up to two nights of raw data plus all history of log files are typically stored in /data0.

On top of that, to be able to hold moths or years of data, there are removable drives. The number of drives depends on the observatory type. DFNITs have just one drive, DFNSMALLs two drives and DFNEXTs three drives. These are mounted as /data1, /data2 and /data3. Every day in late morning the SW in the observatory moves all the data except last night from the /data0 buffer to the removable (archive) drives. They fill up from #1 to #3. Note: When they get completely full, the SW starts compressing the old data - converting rwa (.NEF) images to .jpg, but only those images, where event detection was successfully executed and did not detect any likely fireball event. This compression functionality extends the time before the disk need to be replaced or data remotely deleted.

The data structure in /dataX folders is following:

/data0
├── DFNEXT022
│   ├── 2018
│   │   ├── 01
│   │   │   ├── 2018-01-04_DFNEXT022_1515114584
│   │   │   ├── 2018-01-05_DFNEXT022_1515112201
│   │   │   ├── 2018-01-29_DFNEXT022_1517267518
                     ...
│   │   │   ├── 2018-01-30_DFNEXT022_1517353916
│   │   │   └── 2018-01-31_DFNEXT022_1517440320
│   │   ├── 02
│   │   │   ├── 2018-02-01_DFNEXT022_1517526718
│   │   │   ├── 2018-02-02_DFNEXT022_1517613118
│   │   │   ├── 2018-02-03_DFNEXT022_1517699520