Differences between revisions 1 and 32 (spanning 31 versions)

Segments

File convention in local KAGRA servers

Directory in Kamioka: /users/DET/Segments/ -> /users/DET/Segments/${name}/${yyyy}/
Directory in Kashiwa: /home/detchar/Segments/ -> /home/detchar/Segments/${name}/${yyyy}/
File: SegmentList_foo_UTC_yyyy-mm-dd.txt -> ${name}_SEGMENT_UTC_${yyyy-mm-dd}.txt

Recommendation

All the data analysis must require K1-SCIENCE_MODE is active.

Definition

#	name	definition	file name	description	valid period
1	K1-GRD_SCIENCE_MODE	K1:GRD_IFO_STATE_N == 1000	K1-GRD_SCIENCE_MODE_SEGMENT_UTC_yyyy-mm-dd	Observation mode based on guardian	2020/1/10~
2	K1-GRD_LOCKED	K1:GRD_IFO_STATE_N >= 100 K1:GRD-LSC_LOCK_STATE_N == 1000	K1-GRD_LOCKED_SEGMENT_UTC_yyyy-mm-dd	Interferometer locked	2020/1/10~ 2020/4/7~21
3	K1-GRD_UNLOCKED	K1:GRD_IFO_STATE_N < 100 K1:GRD-LSC_LOCK_STATE_N != 1000	K1-GRD_UNLOCKED_SEGMENT_UTC_yyyy-mm-dd	Not locked	2020/1/10~ 2020/4/7~21
4	K1-OMC_OVERFLOW_OK	K1:FEC-32_ADC_OVERFLOW_0_0 == 0	K1-OMC_OVERFLOW_SEGMENT_OK_UTC_yyyy-mm-dd	No overflow	2020/4/7~21
5	K1-OMC_OVERFLOW_VETO	K1:FEC-32_ADC_OVERFLOW_0_0 != 0	K1-OMC_OVERFLOW_SEGMENT_UTC_yyyy-mm-dd	overflow	2020/4/7~21

6	K1-DAQ_STATUS_BAD	See Broken frame report	K1-DAQ_STATUS_BAD_SEGMENT_UTC_yyyy-mm-dd	Broken frame files	2020/4/7~21
7	K1-SCIENCE_MODE	K1-GRD_SCIENCE_MODE && K1-OMC_OVERFLOW_OK && not K1-DAQ_STATUS_BAD	K1-SCIENCE_MODE_SEGMENT_UTC_yyyy-mm-dd	Science mode	2020/4/7~21
8	K1-DET_FOR_GRB200415A	K1:GRD_IFO_STATE_N == 1000 \| \| (K1:GRD-LSC_LOCK_STATE_N == 1000 && K1:FEC-32_ADC_OVERFLOW_0_0 == 0) on 4/15, other period is identical to K1-SCIENCE_MODE	K1-DET_FOR_GRB_SEGMENT_UTC_yyyy-mm-dd	special definition for GRB200415A see JGW-T2011653	only 4/15


9	K1-GRD_PEM_EARTHQUAKE	K1:GRD_PEM_EARTHQUAKE_STATE_N == 1000	K1-GRD_PEN_EARTHQUAKE_SEGMENT_UTC_yyyy-mm-dd	Earthquake flag	2020/1/22~
10	K1-CAL_CS_PROC_C00_STRAIN_DBL_DQ_SNR100	K1:CAL_CS_PROC_C00_STRAIN_DBL_DQ has glitch of SNR > 100	K1-CAL_CS_PROC_C00_STRAIN_DBL_DQ_SNR100_SEGMENT_UTC_yyyy-mm-dd	Earthquake flag	2020/2/6~

Obsolete

name	definition	file name	description	valid period
	K1:GRD_LSC_LOCK_STATE_N == 1000	SegmentList_FPMI_UTC_yyyy-mm-dd	Observation mode	~2020/1/20
	K1:GRD_LSC_LOCK_STATE_N != 1000	SegmentList_unlocked_UTC_yyyy-mm-dd	NOT Observation mode	~2020/1/20

	K1:GRD-LSC_LOCK_STATE_N == 300	SegmentList_locked_UTC_yyyy-mm-dd	FPMI locked	~2020/1/20
K1-GRD_LOCKED	K1:GRD_IFO_STATE_N >= 100	K1-GRD_LOCKED_SEGMENT_UTC_yyyy-mm-dd	FPMI locked	2020/1/10~4/6
K1-GRD_UNLOCKED	K1:GRD_IFO_STATE_N < 100	K1-GRD_UNLOCKED_SEGMENT_UTC_yyyy-mm-dd	Not locked	2020/1/10~4/6

	K1:GRD_IMC_STATE_N >= 100	SegmentList_IMC_UTC_yyyy-mm-dd	IMC locked	~2020/1/20

Automation

Script: make15minSegment.py (GitHub)
- Schedule: 0:10 (UTC) by crontab on k1det0 (Partial file production every 15 min)
Script: make15minSegment.py (GitHub)
- Schedule: 0:10 (UTC) by crontab on k1det0
Old script: makeDailySegment.py (GitHub)
- Schedule: 0:10 (UTC) by crontab on k1det0

Notes for developer

About sharing data with LIGO on DQSEGDB, please contact Robert Bruntz.
Now K1-SCIENCE_MODE is not generated automatically.
Toward O4, automation of DAQ err segments will be required.

KAGRA/Subgroups/DET/Segments (last edited 2022-11-09 15:47:53 by HirotakaYuzurihara)

-  ⇤ ← Revision 1 as of 2020-01-02 03:04:25 → 
  Size: 841
  Editor: TakahiroYamamoto
  Comment:
+   ← Revision 32 as of 2020-12-09 16:17:19 → ⇥
  Size: 4534
  Editor: chihiro.kozakai
  Comment:
-Deletions are marked like this.
+Additions are marked like this.
 Line 3:
-== File convention ==
Directory: {{{/home/controls/segments}}} -> {{{/home/controls/segments/name/yyyy}}}
File: {{{SegmentList_foo_UTC_yyyy-mm-dd}}} -> {{{name_yyyy-mm-dd}}}
+== File convention in local KAGRA servers ==
  * Directory in Kamioka: {{{/users/DET/Segments/}}} -> {{{/users/DET/Segments/${name}/${yyyy}/}}}
  * Directory in Kashiwa: {{{/home/detchar/Segments/}}} -> {{{/home/detchar/Segments/${name}/${yyyy}/}}}
  * File: {{{SegmentList_foo_UTC_yyyy-mm-dd.txt}}} -> {{{${name}_SEGMENT_UTC_${yyyy-mm-dd}.txt}}}

== Recommendation ==
 * '''All the data analysis must require K1-SCIENCE_MODE is active.'''
-Line 8:
+Line 12:
-|| '''name''' || '''definition'''                || '''file name'''                     || '''description'''    ||
||            || K1:GRD_LSC_LOCK_STATE_N == 1000 || SegmentList_FPMI_UTC_yyyy-mm-dd     || Observation mode     ||
||            || K1:GRD_LSC_LOCK_STATE_N != 1000 || SegmentList_unlocked_UTC_yyyy-mm-dd || NOT Observation mode ||
+||# || '''name''' || '''definition'''                || '''file name'''                     || '''description'''    || '''valid period''' ||
||1 || K1-GRD_SCIENCE_MODE      || K1:GRD_IFO_STATE_N == 1000 || K1-GRD_SCIENCE_MODE_SEGMENT_UTC_yyyy-mm-dd     || Observation mode based on guardian    || 2020/1/10~ ||
||2 || K1-GRD_LOCKED      || --(K1:GRD_IFO_STATE_N >= 100)--<<BR>> K1:GRD-LSC_LOCK_STATE_N == 1000  || K1-GRD_LOCKED_SEGMENT_UTC_yyyy-mm-dd     || Interferometer locked     ||--(2020/1/10~)--<<BR>> 2020/4/7~21 ||
||3 || K1-GRD_UNLOCKED      || --(K1:GRD_IFO_STATE_N < 100)--<<BR>> K1:GRD-LSC_LOCK_STATE_N != 1000 || K1-GRD_UNLOCKED_SEGMENT_UTC_yyyy-mm-dd     || Not locked     || --(2020/1/10~)--<<BR>> 2020/4/7~21 ||
||4 || K1-OMC_OVERFLOW_OK   || K1:FEC-32_ADC_OVERFLOW_0_0 == 0 || K1-OMC_OVERFLOW_SEGMENT_OK_UTC_yyyy-mm-dd || No overflow || 2020/4/7~21 ||
||5 || K1-OMC_OVERFLOW_VETO || K1:FEC-32_ADC_OVERFLOW_0_0 != 0 || K1-OMC_OVERFLOW_SEGMENT_UTC_yyyy-mm-dd || overflow || 2020/4/7~21 ||
|| || || || || || ||
||6 || K1-DAQ_STATUS_BAD || See [[https://gwdoc.icrr.u-tokyo.ac.jp/DocDB/0117/G2011751/001/daqerror_O3GK.pdf|Broken frame report]] || K1-DAQ_STATUS_BAD_SEGMENT_UTC_yyyy-mm-dd || Broken frame files || 2020/4/7~21 ||
||7 || K1-SCIENCE_MODE || K1-GRD_SCIENCE_MODE && K1-OMC_OVERFLOW_OK && not K1-DAQ_STATUS_BAD || K1-SCIENCE_MODE_SEGMENT_UTC_yyyy-mm-dd || Science mode || 2020/4/7~21 ||
||8 || K1-DET_FOR_GRB200415A || K1:GRD_IFO_STATE_N == 1000<<BR>>| | (K1:GRD-LSC_LOCK_STATE_N == 1000 <<BR>>&& K1:FEC-32_ADC_OVERFLOW_0_0 == 0) on 4/15, other period is identical to K1-SCIENCE_MODE|| K1-DET_FOR_GRB_SEGMENT_UTC_yyyy-mm-dd || special definition for GRB200415A<<BR>>see [[https://gwdoc.icrr.u-tokyo.ac.jp/cgi-bin/private/DocDB/ShowDocument?docid=11653|JGW-T2011653]] || only 4/15||
|| || || || || || ||
|| || || || || || ||
||9 || K1-GRD_PEM_EARTHQUAKE      || K1:GRD_PEM_EARTHQUAKE_STATE_N == 1000 || K1-GRD_PEN_EARTHQUAKE_SEGMENT_UTC_yyyy-mm-dd     || Earthquake flag  || 2020/1/22~ ||
||10 || K1-CAL_CS_PROC_C00_STRAIN_DBL_DQ_SNR100      || K1:CAL_CS_PROC_C00_STRAIN_DBL_DQ has glitch of SNR > 100 || K1-CAL_CS_PROC_C00_STRAIN_DBL_DQ_SNR100_SEGMENT_UTC_yyyy-mm-dd     || Earthquake flag  || 2020/2/6~ ||


Obsolete

|| '''name''' || '''definition'''                || '''file name'''                     || '''description'''    || '''valid period''' ||
||            || K1:GRD_LSC_LOCK_STATE_N == 1000 || SegmentList_FPMI_UTC_yyyy-mm-dd     || Observation mode     || ~2020/1/20 ||
||            || K1:GRD_LSC_LOCK_STATE_N != 1000 || SegmentList_unlocked_UTC_yyyy-mm-dd || NOT Observation mode ||~2020/1/20 ||
-Line 12:
+Line 35:
-||            || K1:GRD-LSC_LOCK_STATE_N ==  300 || SegmentList_locked_UTC_yyyy-mm-dd   || FPMI locked          ||
+||            || K1:GRD-LSC_LOCK_STATE_N ==  300 || SegmentList_locked_UTC_yyyy-mm-dd   || FPMI locked          || ~2020/1/20 ||
|| K1-GRD_LOCKED || K1:GRD_IFO_STATE_N >= 100    || K1-GRD_LOCKED_SEGMENT_UTC_yyyy-mm-dd || FPMI locked     || 2020/1/10~4/6 ||
|| K1-GRD_UNLOCKED || K1:GRD_IFO_STATE_N < 100   || K1-GRD_UNLOCKED_SEGMENT_UTC_yyyy-mm-dd || Not locked     || 2020/1/10~4/6 ||
-Line 14:
+Line 39:
-||            || K1:GRD_IMC_STATE_N >=  100      || SegmentList_IMC_UTC_yyyy-mm-dd      || IMC locked           ||
+||            || K1:GRD_IMC_STATE_N >=  100      || SegmentList_IMC_UTC_yyyy-mm-dd      || IMC locked           || ~2020/1/20 ||
-Line 16:
+Line 41:
+== Automation ==
  * Script: make15minSegment.py ([[https://github.com/gw-detchar/tools/blob/master/Segments/Script/make15minSegment.py|GitHub]])
   * Schedule: 0:10 (UTC) by crontab on k1det0 (Partial file production every 15 min)
  * Script: make15minSegment.py ([[https://github.com/gw-detchar/tools/blob/master/Segments/Script/makeConfigSegment.py|GitHub]])
   * Schedule: 0:10 (UTC) by crontab on k1det0
  * Old script: makeDailySegment.py ([[https://github.com/gw-detchar/tools/blob/master/Segments/Script/makeDailySegment.py|GitHub]])
   * Schedule: 0:10 (UTC) by crontab on k1det0


== Notes for developer ==
 * About sharing data with LIGO on DQSEGDB, please contact Robert Bruntz.
 * Now K1-SCIENCE_MODE is not generated automatically.
 * Toward O4, automation of DAQ err segments will be required.