4d — Import

Importing datasets · 4d User Manual

← Back to the Import tab overview

The Import tab

The Import tab watches a folder and brings new microscope files into the project as datasets, optionally processing them on arrival. The window is a two-column split: the left column defines what to import and how, while the right column drives and monitors the import. It is built from six panels, each with a blue title and its own ? button that opens the matching section of this page; the ? at the right end of the IMPORT DATASETS title bar opens the top of the page.

The numbered markers on the screenshot point to each region; the legend and the sections below explain them.

The Import tab with numbered regions 1 2 3 4 5 6 7
#PanelWhat it is and does
1Title barThe IMPORT DATASETS title line; the ? help button at its right end opens this page.
2File Import SettingThe source folder and the import-mode checkboxes (on-start, continuous, link-only, delete, sub-directories, EPU).
3Import SettingsThe import parameters: file filters, file type and extension, gain/dark references, target group.
4Process Imported ImagesWhich processing scripts run automatically as data arrives, and in which order.
5Current StatusDrive and monitor the import: scan, import, and reset buttons, with the live status and disk-space display.
6Import OptionsFile-name parsing (metadata deduced from file names) and the import delay time.
7Import Folder DetailsA live table of every file found in the import folder and its progress through import.

File Import Setting — source folder & import mode

Defines where raw files come from and the ground rules for bringing them in. It contains a directory browser for the import folder (stored as the project's import_dir) and a set of mode checkboxes:

Import Settings — import parameters

The parameter form for the import itself, populated from the project's import parameter lists (e.g. import.params.list, import_nonEPU.params.list). Typical entries include text filters (ignore / only consider files containing a given text), the type of files to import (e.g. H5 files for ptychography) and their file extension, whether the input is already gain-corrected, the gain- and dark-reference file locations, defect/problematic pixel lists, and the target image group into which new datasets are placed. These are ordinary 4d parameters, so their labels, types, and tooltips come from the central parameter definitions and their values are saved with the project.

Process Imported Images — run scripts on arrival

Chooses which processing scripts run automatically as data arrives. Two script lists are combined here:

The combined selection is shown in the list “Scripts to be executed (Blue: During Import, Black: After Import)”, colour-coded by when each runs.

Current Status — drive & monitor the import

The control centre for the import, with a live status line (“N image(s) found in folder of which N image(s) are to be imported”) and a free-disk-space indicator, plus three button groups:

When the delete originals option is active, a red warning banner appears here.

Import Options — file-name parsing & delay

Two acquisition-specific settings:

Import Folder Details — the files table

A live table of every file found in the import folder and its progress through import, with columns:

ColumnMeaning
StateImport state (waiting, importing, imported, …).
Import FolderSource subfolder the file was found in.
Import File NameOriginal file name.
DataThe data file.
XMLAssociated metadata file (shown for EPU imports).
AgeHow long ago the file was created.
Target DirectoryWhere the dataset is placed inside the project.
Combine Continuously import new images with the AutoProcess queue for a live pipeline: datasets are imported as the microscope writes them and processed immediately, so results are ready when the session ends.