Tile Loader Example Workflow

This workflow demonstrates how to combine the tile-by-tile loader with preprocessors to load a large dataset directly into a reduced (and therefore smaller) form. Useful for datasets where the file size is causing problems with memory usage and a preprocessor workflow has already been established.

Tile File

Preprocess Spectra

HyperSpectra

Integrate Spectra

1. Select desired preprocessors.

At least one of the preprocessors should reduce the dataset size (Cut, Integrate) to provide a benefit to using the tile-by-tile loader.
2. Load (or reload) the desired dataset.

The widget should prevent/discourage accidental loading of the full, unpreprocessed file.
3. Continue your analysis as normal.
gASVKwgAAAAAAAB9lCiMEmNvbnRyb2xBcmVhVmlzaWJsZZSIjAxyZWNlbnRfcGF0aHOUXZSMHm9y YW5nZXdpZGdldC51dGlscy5maWxlZGlhbG9nc5SMClJlY2VudFBhdGiUk5QpgZR9lCiMB2Fic3Bh dGiUjG4vL2Nhbm9wdXMvc3RhZmYvcmVhZHMvc3JjL29yYW5nZS1zcGVjdHJvc2NvcHkvb3Jhbmdl Y29udHJpYi9zcGVjdHJvc2NvcHkvZGF0YXNldHMvYWdpbGVudC81X21vc2FpY19hZ2cxMDI0LmRt dJSMBnByZWZpeJSMD3NhbXBsZS1kYXRhc2V0c5SMB3JlbHBhdGiUjBxhZ2lsZW50LzVfbW9zYWlj X2FnZzEwMjQuZG10lIwFdGl0bGWUjACUjAVzaGVldJRoEIwLZmlsZV9mb3JtYXSUTnViYYwLcmVj ZW50X3VybHOUXZSME3NhdmVkV2lkZ2V0R2VvbWV0cnmUQ0IB2dDLAAMAAAAAApMAAADWAAAGRQAA AxsAAAKUAAAA9QAABkQAAAMaAAAAAAAAAAAHgAAAApQAAAD1AAAGRAAAAxqUjAtzaGVldF9uYW1l c5R9lIwGc291cmNllEsAjAN1cmyUaBCMDWRvbWFpbl9lZGl0b3KUfZSMC19fdmVyc2lvbl9flEsB jBBjb250ZXh0X3NldHRpbmdzlF2UKIwVb3Jhbmdld2lkZ2V0LnNldHRpbmdzlIwHQ29udGV4dJST lCmBlH2UKIwGdmFsdWVzlH2UKIwJdmFyaWFibGVzlF2UjAl4bHNfc2hlZXSUaBBK/////4aUaBt9 lGgnXZQoXZQojAsyMDA1LjYwNTk2NZSMFE9yYW5nZS5kYXRhLnZhcmlhYmxllIwSQ29udGludW91 c1ZhcmlhYmxllJOUSwBoEIhlXZQojAsyMDIxLjAzMzcwM5RoMUsAaBCIZV2UKIwLMjAzNi40NjE0 NDGUaDFLAGgQiGVdlCiMCzIwNTEuODg5MTc5lGgxSwBoEIhlXZQojAsyMDY3LjMxNjkxN5RoMUsA aBCIZV2UKIwLMjA4Mi43NDQ2NTaUaDFLAGgQiGVdlCiMCzIwOTguMTcyMzk0lGgxSwBoEIhlXZQo jAVtYXBfeJRoMUsCaBCIZV2UKIwFbWFwX3mUaDFLAmgQiGVdlCiMDzIwMDAuMCAtIDIxMDAuMJRo MUsCaBCIZWVzaB1LAXWMCmF0dHJpYnV0ZXOUKGguSwKGlGgzSwKGlGg1SwKGlGg3SwKGlGg5SwKG lGg7SwKGlGg9SwKGlHSUjAVtZXRhc5RoP0sChpRoQUsChpRoQ0sChpSHlIwKY2xhc3NfdmFyc5Qp jBJtb2RpZmllZF92YXJpYWJsZXOUXZR1YmgiKYGUfZQoaCV9lChoJ12UaCloEEr/////hpRoG32U aCddlChdlCiMCzIwMDUuNjA1OTY1lGgxSwBoEIhlXZQojAsyMDIxLjAzMzcwM5RoMUsAaBCIZV2U KIwLMjAzNi40NjE0NDGUaDFLAGgQiGVdlCiMCzIwNTEuODg5MTc5lGgxSwBoEIhlXZQojAsyMDY3 LjMxNjkxN5RoMUsAaBCIZV2UKIwLMjA4Mi43NDQ2NTaUaDFLAGgQiGVdlCiMCzIwOTguMTcyMzk0 lGgxSwBoEIhlXZQoaD9oMUsCaBCIZV2UKGhBaDFLAmgQiGVlc2gdSwF1aEQoaF1LAoaUaF9LAoaU aGFLAoaUaGNLAoaUaGVLAoaUaGdLAoaUaGlLAoaUdJRoTWg/SwKGlGhBSwKGlIaUaFIpaFNdlHVi aCIpgZR9lCiMBHRpbWWUR0HW1n5oUlWJaCV9lChoJ12UaCloEEr/////hpRoG32UaCddlChdlCiM CzE5OTAuMTc4MjI2lGgxSwBoEIhlXZQojAsyMDA1LjYwNTk2NZRoMUsAaBCIZV2UKIwLMjAyMS4w MzM3MDOUaDFLAGgQiGVdlCiMCzIwMzYuNDYxNDQxlGgxSwBoEIhlXZQojAsyMDUxLjg4OTE3OZRo MUsAaBCIZV2UKIwLMjA2Ny4zMTY5MTeUaDFLAGgQiGVdlCiMCzIwODIuNzQ0NjU2lGgxSwBoEIhl XZQojAsyMDk4LjE3MjM5NJRoMUsAaBCIZV2UKIwLMjExMy42MDAxMzKUaDFLAGgQiGVdlCiMBW1h cF94lGgxSwJoEIhlXZQojAVtYXBfeZRoMUsCaBCIZWVzaB1LAXVoRChogUsChpRog0sChpRohUsC hpRoh0sChpRoiUsChpRoi0sChpRojUsChpRoj0sChpRokUsChpR0lGhNaJNLAoaUaJVLAoaUhpRo UiloU12UdWJoIimBlH2UKGh6R0HW1n6r+IrFaCV9lCiMCXZhcmlhYmxlc5RdlIwJeGxzX3NoZWV0 lGgQSv////+GlIwNZG9tYWluX2VkaXRvcpR9lGinXZQoXZQojA8yMDAwLjAgLSAyMTAwLjCUaDFL AGgQiGVdlChok2gxSwJoEIhlXZQoaJVoMUsCaBCIZWVzaB1LAXVoRGivSwKGlIWUaE1ok0sChpRo lUsChpSGlGhSKWhTXZR1YmgiKYGUfZQoaHpHQdbWfogcc0xoJX2UKGinXZRoqWgQSv////+GlGir fZRop12UKF2UKIwPMjA0MC4wIC0gMjA2MC4wlGgxSwBoEIhlXZQoaJNoMUsCaBCIZV2UKGiVaDFL AmgQiGVlc2gdSwF1aERowEsChpSFlGhNaJNLAoaUaJVLAoaUhpRoUiloU12UdWJldS4=
{'autocommit': True, 'controlAreaVisible': True, 'preview_curves': 3, 'preview_n': 0, 'savedWidgetGeometry': b'\x01\xd9\xd0\xcb\x00\x02\x00\x00\x00\x00\x02b\x00\x00\x01r\x00\x00\x04\xfd\x00\x00\x03\xa1\x00\x00\x02j\x00\x00\x01\x91\x00\x00\x04\xf5\x00\x00\x03\x99\x00\x00\x00\x00\x00\x00\x00\x00\x07\x80', 'storedsettings': {'name': '', 'preprocessors': [('orangecontrib.infrared.cut', {'lowlim': 2000.0, 'highlim': 2100.0}), ('orangecontrib.infrared.baseline', {})]}, 'curveplot': {'invertX': False, 'label_title': '', 'label_xaxis': '', 'label_yaxis': '', 'range_x1': None, 'range_x2': None, 'range_y1': None, 'range_y2': None, 'sample_seed': 0, 'selection_group_saved': None, 'viewtype': 0}, 'curveplot_after': {'invertX': False, 'label_title': '', 'label_xaxis': '', 'label_yaxis': '', 'range_x1': None, 'range_x2': None, 'range_y1': None, 'range_y2': None, 'sample_seed': 0, 'selection_group_saved': None, 'viewtype': 0}, '__version__': 3}
gASVZggAAAAAAAB9lCiMBmNob29zZZSMFW51bXB5LmNvcmUubXVsdGlhcnJheZSMBnNjYWxhcpST lIwFbnVtcHmUjAVkdHlwZZSTlIwCZjiUiYiHlFKUKEsDjAE8lE5OTkr/////Sv////9LAHSUYkMI FcYWgmxWn0CUhpRSlIwPY29tcGF0X25vX2dyb3VwlIiMEmNvbnRyb2xBcmVhVmlzaWJsZZSIjAdo aWdobGltlGgEaApDCA7ABkRYZKBAlIaUUpSMEmludGVncmF0aW9uX21ldGhvZJRLBIwGbG93bGlt lGgPjBNzYXZlZFdpZGdldEdlb21ldHJ5lEMyAdnQywACAAAAAAhFAAAAcgAAC9gAAANUAAAITQAA AJEAAAvQAAADTAAAAAEAAAAAB4CUjBJzaG93X3Zpc2libGVfaW1hZ2WUiYwKdmFsdWVfdHlwZZRL AIwZdmlzaWJsZV9pbWFnZV9jb21wb3NpdGlvbpSMBk5vcm1hbJSMEnZpc2libGVfaW1hZ2VfbmFt ZZSMCEltYWdlIDAxlIwVdmlzaWJsZV9pbWFnZV9vcGFjaXR5lEt4jAljdXJ2ZXBsb3SUfZQojBBj b2xvcl9pbmRpdmlkdWFslImMB2ludmVydFiUiYwLbGFiZWxfdGl0bGWUjACUjAtsYWJlbF94YXhp c5RoJowLbGFiZWxfeWF4aXOUaCaMEXBlYWtfbGFiZWxzX3NhdmVklF2UjAhyYW5nZV94MZROjAhy YW5nZV94MpROjAhyYW5nZV95MZROjAhyYW5nZV95MpROjAtzYW1wbGVfc2VlZJRLAIwVc2VsZWN0 aW9uX2dyb3VwX3NhdmVklE6MCXNob3dfZ3JpZJSJjAh2aWV3dHlwZZRLAXWMCWltYWdlcGxvdJR9 lCiMD2JsdWVfbGV2ZWxfaGlnaJROjA5ibHVlX2xldmVsX2xvd5ROjAVnYW1tYZRLAIwQZ3JlZW5f bGV2ZWxfaGlnaJROjA9ncmVlbl9sZXZlbF9sb3eUTowKbGV2ZWxfaGlnaJROjAlsZXZlbF9sb3eU TowNcGFsZXR0ZV9pbmRleJRLAIwOcmVkX2xldmVsX2hpZ2iUTowNcmVkX2xldmVsX2xvd5ROaDBO jAtzaG93X2xlZ2VuZJSIjA50aHJlc2hvbGRfaGlnaJRHP/AAAAAAAACMDXRocmVzaG9sZF9sb3eU RwAAAAAAAAAAdYwLX192ZXJzaW9uX1+USwaMEGNvbnRleHRfc2V0dGluZ3OUXZQojBVvcmFuZ2V3 aWRnZXQuc2V0dGluZ3OUjAdDb250ZXh0lJOUKYGUfZQojAZ2YWx1ZXOUfZQojAphdHRyX3ZhbHVl lIwFbWFwX3iUS2aGlIwOcmdiX2JsdWVfdmFsdWWUjAsyMDA1LjYwNTk2NZRLZoaUjA9yZ2JfZ3Jl ZW5fdmFsdWWUjAVtYXBfeZRLZoaUjA1yZ2JfcmVkX3ZhbHVllGhNS2aGlGghfZSMDWZlYXR1cmVf Y29sb3KUTkr+////hpRzaDN9lCiMBmF0dHJfeJRoTUtmhpSMBmF0dHJfeZRoU0tmhpR1aEJLBnWM CmF0dHJpYnV0ZXOUfZQoaFBLAowLMjAyMS4wMzM3MDOUSwKMCzIwMzYuNDYxNDQxlEsCjAsyMDUx Ljg4OTE3OZRLAowLMjA2Ny4zMTY5MTeUSwKMCzIwODIuNzQ0NjU2lEsCjAsyMDk4LjE3MjM5NJRL AnWMBW1ldGFzlH2UKGhNSwJoU0sCjA8yMDAwLjAgLSAyMTAwLjCUSwJ1dWJoRymBlH2UKGhKfZQo aExoTUtmhpRoT4wLMjAwNS42MDU5NjWUS2aGlGhSaFNLZoaUaFVoTUtmhpRoIX2UaFhOSv7///+G lHNoM32UKGhbaE1LZoaUaF1oU0tmhpR1aEJLBnVoX32UKGhuSwKMCzIwMjEuMDMzNzAzlEsCjAsy MDM2LjQ2MTQ0MZRLAowLMjA1MS44ODkxNzmUSwKMCzIwNjcuMzE2OTE3lEsCjAsyMDgyLjc0NDY1 NpRLAowLMjA5OC4xNzIzOTSUSwJ1aGd9lChoTUsCaFNLAnV1YmhHKYGUfZQojAR0aW1llEdB1tZ+ q/8+VGhKfZQojAphdHRyX3ZhbHVllIwFbWFwX3iUS2aGlIwJY3VydmVwbG90lH2UjA1mZWF0dXJl X2NvbG9ylE5K/v///4aUc4wJaW1hZ2VwbG90lH2UKIwGYXR0cl94lGiES2aGlIwGYXR0cl95lIwF bWFwX3mUS2aGlHVoQksGdWhffZSMDzIwMDAuMCAtIDIxMDAuMJRLAnNoZ32UKGiESwJoj0sCdXVi aEcpgZR9lChogUdB1tZ+aFlbyGhKfZQoaExoTUtmhpRoT4wLMTk5MC4xNzgyMjaUS2aGlGhSaFNL ZoaUaFVoTUtmhpRoIX2UaFhOSv7///+GlHNoM32UKGhbaE1LZoaUaF1oU0tmhpR1aEJLBnVoX32U KIwLMTk5MC4xNzgyMjaUSwKMCzIwMDUuNjA1OTY1lEsCjAsyMDIxLjAzMzcwM5RLAowLMjAzNi40 NjE0NDGUSwKMCzIwNTEuODg5MTc5lEsCjAsyMDY3LjMxNjkxN5RLAowLMjA4Mi43NDQ2NTaUSwKM CzIwOTguMTcyMzk0lEsCjAsyMTEzLjYwMDEzMpRLAnVoZ32UKGiESwJoj0sCdXViaEcpgZR9lCho gUdB1tZ+iCMUsWhKfZQoaINohEtmhpRohn2UaIhOSv7///+GlHNoin2UKGiMaIRLZoaUaI5oj0tm hpR1aEJLBnVoX32UjA8yMDQwLjAgLSAyMDYwLjCUSwJzaGd9lChohEsCaI9LAnV1YmV1Lg==
{'autocommit': True, 'controlAreaVisible': True, 'output_metas': False, 'preview_curves': 8, 'preview_n': [], 'process_reference': True, 'savedWidgetGeometry': b'\x01\xd9\xd0\xcb\x00\x03\x00\x00\x00\x00\x00\xf6\x00\x00\x00z\x00\x00\x04K\x00\x00\x02\x94\x00\x00\x00\xf7\x00\x00\x00\x99\x00\x00\x04J\x00\x00\x02\x93\x00\x00\x00\x00\x00\x00\x00\x00\x07\x80\x00\x00\x00\xf7\x00\x00\x00\x99\x00\x00\x04J\x00\x00\x02\x93', 'storedsettings': {'name': '', 'preprocessors': [('orangecontrib.infrared.integrate.simple', {'High limit': 2100.0, 'Low limit': 2000.0})]}, 'curveplot': {'color_individual': False, 'invertX': False, 'label_title': '', 'label_xaxis': '', 'label_yaxis': '', 'peak_labels_saved': [], 'range_x1': None, 'range_x2': None, 'range_y1': None, 'range_y2': None, 'sample_seed': 0, 'selection_group_saved': None, 'show_grid': False, 'viewtype': 0}, 'curveplot_after': {'color_individual': False, 'invertX': False, 'label_title': '', 'label_xaxis': '', 'label_yaxis': '', 'peak_labels_saved': [], 'range_x1': None, 'range_x2': None, 'range_y1': None, 'range_y2': None, 'sample_seed': 0, 'selection_group_saved': None, 'show_grid': False, 'viewtype': 0}, '__version__': 2}