Differences between revisions 30 and 31

Segments

== File convention in local KAGRA servers==

Directory in Kamioka: /users/DET/Segments/ -> /users/DET/Segments/${name}/${yyyy}/
Directory in Kashiwa: /home/detchar/Segments/ -> /home/detchar/Segments/${name}/${yyyy}/
File: SegmentList_foo_UTC_yyyy-mm-dd.txt -> ${name}_SEGMENT_UTC_${yyyy-mm-dd}.txt

Recommendation

All the data analysis must require K1-SCIENCE_MODE is active.

Definition

#	name	definition	file name	description	valid period
1	K1-GRD_SCIENCE_MODE	K1:GRD_IFO_STATE_N == 1000	K1-GRD_SCIENCE_MODE_SEGMENT_UTC_yyyy-mm-dd	Observation mode based on guardian	2020/1/10~
2	K1-GRD_LOCKED	K1:GRD_IFO_STATE_N >= 100 K1:GRD-LSC_LOCK_STATE_N == 1000	K1-GRD_LOCKED_SEGMENT_UTC_yyyy-mm-dd	Interferometer locked	2020/1/10~ 2020/4/7~21
3	K1-GRD_UNLOCKED	K1:GRD_IFO_STATE_N < 100 K1:GRD-LSC_LOCK_STATE_N != 1000	K1-GRD_UNLOCKED_SEGMENT_UTC_yyyy-mm-dd	Not locked	2020/1/10~ 2020/4/7~21
4	K1-OMC_OVERFLOW_OK	K1:FEC-32_ADC_OVERFLOW_0_0 == 0	K1-OMC_OVERFLOW_SEGMENT_OK_UTC_yyyy-mm-dd	No overflow	2020/4/7~21
5	K1-OMC_OVERFLOW_VETO	K1:FEC-32_ADC_OVERFLOW_0_0 != 0	K1-OMC_OVERFLOW_SEGMENT_UTC_yyyy-mm-dd	overflow	2020/4/7~21

6	K1-DAQ_STATUS_BAD	See Broken frame report	K1-DAQ_STATUS_BAD_SEGMENT_UTC_yyyy-mm-dd	Broken frame files	2020/4/7~21
7	K1-SCIENCE_MODE	K1-GRD_SCIENCE_MODE && K1-OMC_OVERFLOW_OK && not K1-DAQ_STATUS_BAD	K1-SCIENCE_MODE_SEGMENT_UTC_yyyy-mm-dd	Science mode	2020/4/7~21
8	K1-DET_FOR_GRB200415A	K1:GRD_IFO_STATE_N == 1000 \| \| (K1:GRD-LSC_LOCK_STATE_N == 1000 && K1:FEC-32_ADC_OVERFLOW_0_0 == 0) on 4/15, other period is identical to K1-SCIENCE_MODE	K1-DET_FOR_GRB_SEGMENT_UTC_yyyy-mm-dd	special definition for GRB200415A see JGW-T2011653	only 4/15


9	K1-GRD_PEM_EARTHQUAKE	K1:GRD_PEM_EARTHQUAKE_STATE_N == 1000	K1-GRD_PEN_EARTHQUAKE_SEGMENT_UTC_yyyy-mm-dd	Earthquake flag	2020/1/22~
10	K1-CAL_CS_PROC_C00_STRAIN_DBL_DQ_SNR100	K1:CAL_CS_PROC_C00_STRAIN_DBL_DQ has glitch of SNR > 100	K1-CAL_CS_PROC_C00_STRAIN_DBL_DQ_SNR100_SEGMENT_UTC_yyyy-mm-dd	Earthquake flag	2020/2/6~

Obsolete

name	definition	file name	description	valid period
	K1:GRD_LSC_LOCK_STATE_N == 1000	SegmentList_FPMI_UTC_yyyy-mm-dd	Observation mode	~2020/1/20
	K1:GRD_LSC_LOCK_STATE_N != 1000	SegmentList_unlocked_UTC_yyyy-mm-dd	NOT Observation mode	~2020/1/20

	K1:GRD-LSC_LOCK_STATE_N == 300	SegmentList_locked_UTC_yyyy-mm-dd	FPMI locked	~2020/1/20
K1-GRD_LOCKED	K1:GRD_IFO_STATE_N >= 100	K1-GRD_LOCKED_SEGMENT_UTC_yyyy-mm-dd	FPMI locked	2020/1/10~4/6
K1-GRD_UNLOCKED	K1:GRD_IFO_STATE_N < 100	K1-GRD_UNLOCKED_SEGMENT_UTC_yyyy-mm-dd	Not locked	2020/1/10~4/6

	K1:GRD_IMC_STATE_N >= 100	SegmentList_IMC_UTC_yyyy-mm-dd	IMC locked	~2020/1/20

Automation

Script: make15minSegment.py (GitHub)
- Schedule: 0:10 (UTC) by crontab on k1det0 (Partial file production every 15 min)
Script: make15minSegment.py (GitHub)
- Schedule: 0:10 (UTC) by crontab on k1det0
Old script: makeDailySegment.py (GitHub)
- Schedule: 0:10 (UTC) by crontab on k1det0

Notes for developer

About sharing data with LIGO on DQSEGDB, please contact Robert Bruntz.
Now K1-SCIENCE_MODE is not generated automatically.
Toward O4, automation of DAQ err segments will be required.

KAGRA/Subgroups/DET/Segments (last edited 2022-11-09 15:47:53 by HirotakaYuzurihara)

-  ⇤ ← Revision 30 as of 2020-12-09 15:15:24 → 
  Size: 4370
  Editor: chihiro.kozakai
  Comment:
+   ← Revision 31 as of 2020-12-09 16:16:58 → ⇥
  Size: 4533
  Editor: chihiro.kozakai
  Comment:
-Deletions are marked like this.
+Additions are marked like this.
 Line 3:
-== File convention ==
  * Directory in Kamioka: {{{/users/DET/Segments/}}} -> {{{/users/DET/Segments/${name}/yyyy/}}}
  * Directory in Kashiwa: {{{/home/detchar/Segments/}}} -> {{{/home/detchar/Segments/name/yyyy/}}}
  * File: {{{SegmentList_foo_UTC_yyyy-mm-dd.txt}}} -> {{{name_SEGMENT_UTC_yyyy-mm-dd.txt}}}
+== File convention in local KAGRA servers==
  * Directory in Kamioka: {{{/users/DET/Segments/}}} -> {{{/users/DET/Segments/${name}/${yyyy}/}}}
  * Directory in Kashiwa: {{{/home/detchar/Segments/}}} -> {{{/home/detchar/Segments/${name}/${yyyy}/}}}
  * File: {{{SegmentList_foo_UTC_yyyy-mm-dd.txt}}} -> {{{${name}_SEGMENT_UTC_${yyyy-mm-dd}.txt}}}
 Line 9:
- * '''All the data analysis must require K1-GRD_SCIENCE_MODE is active.'''
 * If your analysis is affected by configuration change: K1-DET_CONFIG_Vn will change the number when KAGRA configuration changes. Please use consistent configuration.
+ * '''All the data analysis must require K1-SCIENCE_MODE is active.'''
-Line 15:
+Line 14:
-||1 || K1-GRD_SCIENCE_MODE      || K1:GRD_IFO_STATE_N == 1000 || K1-GRD_SCIENCE_MODE_SEGMENT_UTC_yyyy-mm-dd     || Observation mode     || 2020/1/10~ ||
+||1 || K1-GRD_SCIENCE_MODE      || K1:GRD_IFO_STATE_N == 1000 || K1-GRD_SCIENCE_MODE_SEGMENT_UTC_yyyy-mm-dd     || Observation mode based on guardian    || 2020/1/10~ ||
-Line 21:
+Line 20:
-||6 || K1-DET_FOR_GRB || K1:GRD_IFO_STATE_N == 1000<<BR>>| | (K1:GRD-LSC_LOCK_STATE_N == 1000 <<BR>>&& K1:FEC-32_ADC_OVERFLOW_0_0 == 0) || K1-DET_FOR_GRB_SEGMENT_UTC_yyyy-mm-dd || special definition for GRB<<BR>>see [[https://gwdoc.icrr.u-tokyo.ac.jp/cgi-bin/private/DocDB/ShowDocument?docid=11653|JGW-T2011653]] || only 4/15||
+||6 || K1-DAQ_STATUS_BAD || See [[https://gwdoc.icrr.u-tokyo.ac.jp/DocDB/0117/G2011751/001/daqerror_O3GK.pdf|Broken frame report]] || K1-DAQ_STATUS_BAD_SEGMENT_UTC_yyyy-mm-dd || Broken frame files || 2020/4/7~21 ||
||7 || K1-SCIENCE_MODE || K1-GRD_SCIENCE_MODE && K1-OMC_OVERFLOW_OK && not K1-DAQ_STATUS_BAD || K1-SCIENCE_MODE_SEGMENT_UTC_yyyy-mm-dd || Science mode || 2020/4/7~21 ||
||8 || K1-DET_FOR_GRB200415A || K1:GRD_IFO_STATE_N == 1000<<BR>>| | (K1:GRD-LSC_LOCK_STATE_N == 1000 <<BR>>&& K1:FEC-32_ADC_OVERFLOW_0_0 == 0) on 4/15, other period is identical to K1-SCIENCE_MODE|| K1-DET_FOR_GRB_SEGMENT_UTC_yyyy-mm-dd || special definition for GRB200415A<<BR>>see [[https://gwdoc.icrr.u-tokyo.ac.jp/cgi-bin/private/DocDB/ShowDocument?docid=11653|JGW-T2011653]] || only 4/15||
-Line 24:
+Line 25:
-||7 || K1-GRD_PEM_EARTHQUAKE      || K1:GRD_PEM_EARTHQUAKE_STATE_N == 1000 || K1-GRD_PEN_EARTHQUAKE_SEGMENT_UTC_yyyy-mm-dd     || Earthquake flag  || 2020/1/22~ ||
||8 || K1-CAL_CS_PROC_C00_STRAIN_DBL_DQ_SNR100      || K1:CAL_CS_PROC_C00_STRAIN_DBL_DQ has glitch of SNR > 100 || K1-CAL_CS_PROC_C00_STRAIN_DBL_DQ_SNR100_SEGMENT_UTC_yyyy-mm-dd     || Earthquake flag  || 2020/2/6~ ||
||9 || K1-DET_CONFIG_COMMISSIONING      || Commissioning phase before O3. 2020/1/10~2020/2/18 || K1-DET_CONFIG_COMMISSIONING_SEGMENT_UTC_yyyy-mm-dd     ||  Commissioning phase before O3     ||2020/1/10~ ||
||10|| K1-DET_CONFIG_O3_V1      || O3 KAGRA configuration version 1. 2020/2/18~2020/4/30 || K1-DET_CONFIG_O3_V1_SEGMENT_UTC_yyyy-mm-dd     ||  1st configuration of KAGRA in O3  ||2020/1/10~ ||
+||9 || K1-GRD_PEM_EARTHQUAKE      || K1:GRD_PEM_EARTHQUAKE_STATE_N == 1000 || K1-GRD_PEN_EARTHQUAKE_SEGMENT_UTC_yyyy-mm-dd     || Earthquake flag  || 2020/1/22~ ||
||10 || K1-CAL_CS_PROC_C00_STRAIN_DBL_DQ_SNR100      || K1:CAL_CS_PROC_C00_STRAIN_DBL_DQ has glitch of SNR > 100 || K1-CAL_CS_PROC_C00_STRAIN_DBL_DQ_SNR100_SEGMENT_UTC_yyyy-mm-dd     || Earthquake flag  || 2020/2/6~ ||
 Line 49:
+== Notes for developer ==
 * About sharing data with LIGO on DQSEGDB, please contact Robert Bruntz.
 * Now K1-SCIENCE_MODE is not generated automatically.
 * Toward O4, automation of DAQ err segments will be required.