[23:36:28.587] I [ wct ] loading compressed json file: /wcdo/share/wirecell/data/protodune-wires-larsoft-v4.json.bz2 [23:36:30.682] I [ wct ] loading compressed json file: /wcdo/share/wirecell/data/garfield-1d-boundary-path-rev-dune.json.bz2 [23:36:33.046] I [pytorch ] Model: model.ts loaded [23:36:33.583] I [ tbb ] TbbFlow::connect [23:36:36.124] I [ tbb ] TbbFlow: run: [23:36:40.112] W [sigproc ] OmnibusNoiseFilter: warning, truncated or extended 635 samples [23:36:53.071] I [sigproc ] ROI_refinement::MultiPlaneProtection: [23:36:53.165] I [sigproc ] ROI_refinement::MultiPlaneROI: [23:36:53.679] I [sigproc ] ROI_refinement::MultiPlaneProtection: [23:36:53.764] I [sigproc ] ROI_refinement::MultiPlaneProtection: [23:36:53.806] I [sigproc ] ROI_refinement::MultiPlaneROI: [23:36:53.922] I [sigproc ] ROI_refinement::MultiPlaneProtection: [23:36:53.938] I [sigproc ] ROI_refinement::MultiPlaneROI: [23:36:54.115] I [sigproc ] ROI_refinement::MultiPlaneProtection: [23:36:54.477] I [sigproc ] ROI_refinement::MultiPlaneROI: [23:36:54.489] I [sigproc ] ROI_refinement::MultiPlaneROI: [23:36:54.615] I [sigproc ] ROI_refinement::MultiPlaneProtection: [23:36:55.171] I [sigproc ] ROI_refinement::MultiPlaneROI: [23:37:01.558] I [sigproc ] ROI_refinement::MultiPlaneProtection: [23:37:01.726] I [sigproc ] ROI_refinement::MultiPlaneROI: [23:37:02.075] I [sigproc ] ROI_refinement::MultiPlaneProtection: [23:37:02.268] I [sigproc ] ROI_refinement::MultiPlaneROI: [23:37:03.447] I [sigproc ] ROI_refinement::MultiPlaneProtection: [23:37:03.696] I [sigproc ] ROI_refinement::MultiPlaneROI: [23:37:04.416] I [sigproc ] ROI_refinement::MultiPlaneProtection: [23:37:04.658] I [sigproc ] ROI_refinement::MultiPlaneROI: [23:37:06.519] I [sigproc ] ROI_refinement::MultiPlaneProtection: [23:37:06.697] I [sigproc ] ROI_refinement::MultiPlaneProtection: [23:37:06.749] I [sigproc ] ROI_refinement::MultiPlaneROI: [23:37:07.050] I [sigproc ] ROI_refinement::MultiPlaneROI: [23:37:09.355] I [sigproc ] ROI_refinement::MultiPlaneProtection: [23:37:09.502] I [sigproc ] ROI_refinement::MultiPlaneROI: [23:37:15.267] I [sigproc ] ROI_refinement::MultiPlaneProtection: [23:37:15.346] I [sigproc ] ROI_refinement::MultiPlaneROI: [23:37:16.405] I [sigproc ] ROI_refinement::MultiPlaneProtection: [23:37:16.590] I [sigproc ] ROI_refinement::MultiPlaneROI: [23:37:20.416] I [sigproc ] ROI_refinement::MultiPlaneProtection: [23:37:20.652] I [sigproc ] ROI_refinement::MultiPlaneROI: [23:37:20.765] I [sigproc ] ROI_refinement::MultiPlaneProtection: [23:37:20.905] I [sigproc ] ROI_refinement::MultiPlaneROI: [23:37:26.460] I [sigproc ] ROI_refinement::MultiPlaneProtection: [23:37:26.614] I [sigproc ] ROI_refinement::MultiPlaneROI: [23:37:41.333] I [pytorch ] frame2eigen: 0.28 [23:37:41.401] I [pytorch ] eigen2tensor: 0.83 [23:37:47.380] I [pytorch ] total_wait_time: 0 sec [23:37:47.784] I [pytorch ] forward: 44.73 [23:37:47.800] I [pytorch ] tensor2eigen: 0.11 [23:37:47.828] I [pytorch ] decon_charge_eigen: ncols: 6000 nrows: 800 [23:37:47.871] I [pytorch ] ncols: 800 nrows: 6000 [23:37:48.723] I [pytorch ] h5: 5.96 [23:37:48.728] I [pytorch ] DNNROIFinding: produce 800 traces: 800 [23:37:48.728] I [pytorch ] timer summary: [23:37:48.728] I [pytorch ] h5 : 5.96 [23:37:48.728] I [pytorch ] tensor2eigen : 0.11 [23:37:48.728] I [pytorch ] frame2eigen : 0.28 [23:37:48.728] I [pytorch ] forward : 44.73 [23:37:48.728] I [pytorch ] eigen2tensor : 0.83 [23:37:54.526] I [pytorch ] frame2eigen: 0.24 [23:37:54.530] I [pytorch ] eigen2tensor: 0.03 [23:37:54.575] I [pytorch ] frame2eigen: 0.24 [23:37:55.016] I [pytorch ] eigen2tensor: 2.2 [23:38:00.628] I [pytorch ] frame2eigen: 0.21 [23:38:01.037] I [pytorch ] eigen2tensor: 1.64 [23:38:12.686] I [pytorch ] total_wait_time: 7 sec [23:38:13.087] I [pytorch ] forward: 76.29 [23:38:13.100] I [pytorch ] tensor2eigen: 0.06 [23:38:13.126] I [pytorch ] decon_charge_eigen: ncols: 6000 nrows: 800 [23:38:13.156] I [pytorch ] ncols: 800 nrows: 6000 [23:38:14.007] I [pytorch ] h5: 3.5 [23:38:14.012] I [pytorch ] DNNROIFinding: produce 800 traces: 800 [23:38:14.012] I [pytorch ] timer summary: [23:38:14.012] I [pytorch ] h5 : 3.5 [23:38:14.012] I [pytorch ] tensor2eigen : 0.06 [23:38:14.012] I [pytorch ] frame2eigen : 0.24 [23:38:14.012] I [pytorch ] forward : 76.29 [23:38:14.012] I [pytorch ] eigen2tensor : 0.03 [23:38:14.315] I [pytorch ] total_wait_time: 8 sec [23:38:14.650] I [pytorch ] frame2eigen: 0.19 [23:38:14.729] I [pytorch ] forward: 80.99 [23:38:14.731] I [pytorch ] eigen2tensor: 0.33 [23:38:14.746] I [pytorch ] tensor2eigen: 0.09 [23:38:14.770] I [pytorch ] decon_charge_eigen: ncols: 6000 nrows: 800 [23:38:14.800] I [pytorch ] ncols: 800 nrows: 6000 [23:38:15.281] I [pytorch ] frame2eigen: 0.17 [23:38:15.283] I [pytorch ] eigen2tensor: 0.01 [23:38:15.656] I [pytorch ] h5: 2.96 [23:38:15.663] I [pytorch ] DNNROIFinding: produce 800 traces: 800 [23:38:15.663] I [pytorch ] timer summary: [23:38:15.663] I [pytorch ] h5 : 2.96 [23:38:15.663] I [pytorch ] tensor2eigen : 0.09 [23:38:15.663] I [pytorch ] frame2eigen : 0.24 [23:38:15.663] I [pytorch ] forward : 80.99 [23:38:15.663] I [pytorch ] eigen2tensor : 2.2 [23:38:32.676] I [pytorch ] total_wait_time: 10.5 sec [23:38:33.083] I [pytorch ] forward: 32.34 [23:38:33.096] I [pytorch ] tensor2eigen: 0.05 [23:38:33.119] I [pytorch ] decon_charge_eigen: ncols: 6000 nrows: 800 [23:38:33.151] I [pytorch ] ncols: 800 nrows: 6000 [23:38:34.024] I [pytorch ] h5: 2.13 [23:38:34.031] I [pytorch ] DNNROIFinding: produce 800 traces: 800 [23:38:34.031] I [pytorch ] timer summary: [23:38:34.031] I [pytorch ] h5 : 2.13 [23:38:34.031] I [pytorch ] tensor2eigen : 0.05 [23:38:34.031] I [pytorch ] frame2eigen : 0.17 [23:38:34.031] I [pytorch ] forward : 32.34 [23:38:34.031] I [pytorch ] eigen2tensor : 0.01 [23:38:34.924] I [pytorch ] total_wait_time: 20.5 sec [23:38:35.333] I [pytorch ] forward: 91.3 [23:38:35.346] I [pytorch ] tensor2eigen: 0.06 [23:38:35.360] I [pytorch ] total_wait_time: 12 sec [23:38:35.374] I [pytorch ] decon_charge_eigen: ncols: 6000 nrows: 800 [23:38:35.407] I [pytorch ] ncols: 800 nrows: 6000 [23:38:35.645] I [pytorch ] forward: 41.64 [23:38:35.658] I [pytorch ] tensor2eigen: 0.04 [23:38:35.684] I [pytorch ] decon_charge_eigen: ncols: 6000 nrows: 800 [23:38:35.713] I [pytorch ] ncols: 800 nrows: 6000 [23:38:36.287] I [pytorch ] h5: 2.81 [23:38:36.294] I [pytorch ] DNNROIFinding: produce 800 traces: 800 [23:38:36.294] I [pytorch ] timer summary: [23:38:36.294] I [pytorch ] h5 : 2.81 [23:38:36.294] I [pytorch ] tensor2eigen : 0.06 [23:38:36.294] I [pytorch ] frame2eigen : 0.21 [23:38:36.294] I [pytorch ] forward : 91.3 [23:38:36.294] I [pytorch ] eigen2tensor : 1.64 [23:38:36.618] I [pytorch ] h5: 2.71 [23:38:36.624] I [pytorch ] DNNROIFinding: produce 800 traces: 800 [23:38:36.624] I [pytorch ] timer summary: [23:38:36.624] I [pytorch ] h5 : 2.71 [23:38:36.624] I [pytorch ] tensor2eigen : 0.04 [23:38:36.624] I [pytorch ] frame2eigen : 0.19 [23:38:36.624] I [pytorch ] forward : 41.64 [23:38:36.624] I [pytorch ] eigen2tensor : 0.33