Sorting Data - Revision history

Ttang: /* Overiew */

2021-01-21T19:19:56Z

Overiew

← Older revision		Revision as of 19:19, January 21, 2021
Line 4:		Line 4:
	* '''GEBMerge''' is used to time-stamp sort all digitizer / ioc data files of type ''gtd''		* '''GEBMerge''' is used to time-stamp sort all digitizer / ioc data files of type ''gtd''

	* '''~~GEBSort_nogeb~~''' is used to create ''events'' in the data and process the data if desired. Presently, it passes all of the header information to a ROOT TTree file. Trace data can also be passed if so chosen.		* '''EventBuilder''' is used to create ''events'' in the data and process the data if desired. Presently, it passes all of the header information to a ROOT TTree file. Trace data can also be passed if so chosen.

	* '''~~GEBSort_nogeb_trace~~''' is same as GEBSort_nogeb, but with trace		* '''EventBuilder_trace''' is same as GEBSort_nogeb, but with trace

2019-11-09T22:15:51Z

Overiew

← Older revision		Revision as of 22:15, November 9, 2019
Line 5:		Line 5:

	* '''GEBSort_nogeb''' is used to create ''events'' in the data and process the data if desired. Presently, it passes all of the header information to a ROOT TTree file. Trace data can also be passed if so chosen.		* '''GEBSort_nogeb''' is used to create ''events'' in the data and process the data if desired. Presently, it passes all of the header information to a ROOT TTree file. Trace data can also be passed if so chosen.

			* '''GEBSort_nogeb_trace''' is same as GEBSort_nogeb, but with trace


	Both files have ''*.chat'' files that define the parameters of the sort. For example, the number of pieces of data to sort, or the coincidence window defining an ''event''.		Both files have ''*.chat'' files that define the parameters of the sort. For example, the number of pieces of data to sort, or the coincidence window defining an ''event''.

2017-11-29T16:55:57Z

LCRC Computing

← Older revision		Revision as of 16:55, November 29, 2017
Line 59:		Line 59:

	Submitting a bash script with ''qsub'' and the ''PBS''		Submitting a bash script with ''qsub'' and the ''PBS''
	example script that I got working (rcnp_selector.pbs) or link to better description ():		example script that I got working (rcnp_selector.pbs) or link to better description ([[File:PBS Script 0.pdf\|thumb]]):

	#!/bin/sh		#!/bin/sh

2017-11-29T16:52:18Z

LCRC Computing

← Older revision		Revision as of 16:52, November 29, 2017
Line 59:		Line 59:

	Submitting a bash script with ''qsub'' and the ''PBS''		Submitting a bash script with ''qsub'' and the ''PBS''
	example script that I got working (rcnp_selector.pbs):		example script that I got working (rcnp_selector.pbs) or link to better description ():

	#!/bin/sh		#!/bin/sh

2017-09-28T22:01:49Z

LCRC Computing

← Older revision		Revision as of 22:01, September 28, 2017
Line 41:		Line 41:
	- from online globus point and login to LCRC		- from online globus point and login to LCRC
	- can setup script on 'local' machine to 'push' data to LCRC		- can setup script on 'local' machine to 'push' data to LCRC
	-		- go to transfer after logging into globus.org
			- Find "local connect" then choose LCRC DTN
			- "local connects" on both DigiOS [DigiOS DAQ] and Sonata
			- select proper directories (may have to login to LCRC)
			- click options for transfer, click arrow to start transfer

	sorting data on LCRC		sorting data on LCRC

2017-09-28T21:57:14Z

Transferring Data

← Older revision		Revision as of 21:57, September 28, 2017
Line 98:		Line 98:
	Execute		Execute
	globusconnect		globusconnect

	To run the globusconnect and to connect on DigiOS, then need to login to the LCRC to be able to transfer the data		To run the globusconnect and to connect on DigiOS, then need to login to the LCRC to be able to transfer the data

2017-09-28T20:40:18Z

Transferring Data

← Older revision		Revision as of 20:40, September 28, 2017
Line 90:		Line 90:

	This reached ~100 MB/s with computer directly connected to either the NAT Box or the switch		This reached ~100 MB/s with computer directly connected to either the NAT Box or the switch

			Trying to setup a globusconnect point on the DigiOS DAQ computer directly
			www.globus.org

			e3fe9032-34fc-49f1-a9a7-ea98bc99330b

			Execute
			globusconnect

			To run the globusconnect and to connect on DigiOS, then need to login to the LCRC to be able to transfer the data

	== Example ==		== Example ==

2017-06-29T19:50:56Z

LCRC Computing

← Older revision		Revision as of 19:50, June 29, 2017
Line 70:		Line 70:
	the run		the run
	qsub rcnp_selector.pbs		qsub rcnp_selector.pbs

	submits job in the que, gives it an id number as well,		submits job in the que, gives it an id number as well,
	must wait for it to run, various commands to check on it		must wait for it to run, various commands to check on it

			1664586.bmgt1.lcrc.anl.gov

	showq [-i] [-u uname]		showq [-i] [-u uname]

2017-06-29T19:45:39Z

LCRC Computing

← Older revision		Revision as of 19:45, June 29, 2017
Line 55:		Line 55:

	Submitting a bash script with ''qsub'' and the ''PBS''		Submitting a bash script with ''qsub'' and the ''PBS''
	example script that I got working		example script that I got working (rcnp_selector.pbs):

	#!/bin/sh		#!/bin/sh
Line 67:		Line 67:
	pwd		pwd
	root -l -b /home/crhoffman/rcnp_benchmark/rcnp/RunSelector_LCRC.C		root -l -b /home/crhoffman/rcnp_benchmark/rcnp/RunSelector_LCRC.C

			the run
			qsub rcnp_selector.pbs

			submits job in the que, gives it an id number as well,
			must wait for it to run, various commands to check on it

			showq [-i] [-u uname]

			when finished, get two files in home directory
			rcnp.e1664448 rcnp.o1664448

	to do ... setting up multiple instances of same process		to do ... setting up multiple instances of same process

2017-06-29T19:35:02Z

LCRC Computing

← Older revision		Revision as of 19:35, June 29, 2017
Line 52:		Line 52:
	job 101.blues.lcrc.anl.gov ready		job 101.blues.lcrc.anl.gov ready
	To quit your interactive job, run:		To quit your interactive job, run:
			$ logout

	$ ~~logout~~		Submitting a bash script with ''qsub'' and the ''PBS''
			example script that I got working

			#!/bin/sh

			#PBS -N rcnp
			#PBS -l nodes=1:ppn=16
			#PBS -l walltime=0:05:00

			cd $PBS_O_WORKDIR
			cd /home/crhoffman/rcnp_benchmark/rcnp
			pwd
			root -l -b /home/crhoffman/rcnp_benchmark/rcnp/RunSelector_LCRC.C

	setting up multiple instances of same process		to do ... setting up multiple instances of same process
	'''swift'' multiple run numbers at once		'''swift'' multiple run numbers at once