Differences between revisions 2 and 44 (spanning 42 versions)
Revision 2 as of 2019-12-18 17:39:53
Size: 4337
Comment:
Revision 44 as of 2019-12-20 21:10:18
Size: 6097
Comment:
Deletions are marked like this. Additions are marked like this.
Line 1: Line 1:
= Engineering Run December 2019 = /* = Engineering Run December 2019 = */
= Engineering Run 3 =
Line 4: Line 5:
== Date ==
Line 6: Line 8:
 * GPS:  * GPS: 1260604818 -- 1261180818
Line 21: Line 23:
 * channel name

  * From [[http://gwwiki.icrr.u-tokyo.ac.jp/JGWwiki/KAGRA/Subgroups/DET/RUN#ER_with_MICH_on_Jul._13 | ER2 (DetChar)]]
  * K1:CAL-CS_PROC_MICH_DISPLACEMENT_DQ (We used this channel.)
  * K1:CAL-CS_PROC_IMC_FREQUENCY_DQ

 * Low latency data channels
  * K1:DCS-CALIB_STRAIN_C10 16384
  * K1:DCS-CALIB_STATE_VECTOR_C10 16
  * K1:CAL-CS_PROC_IMC_FREQUENCY_DQ 16384
 * h(t) channel name
  * full : '''K1:CAL-CS_PROC_C00_STRAIN_DBL_DQ'''
  * ll_merged : '''K1:DCS-CALIB_STRAIN_C10'''
Line 33: Line 28:

  * K1:GRD-LSC_LOCK_STATE_N = 157
  * definition : '''K1:GRD-LSC_LOCK_STATE_N = 1000'''
  * Based on this definition, detchar group provides the segment file in m31-01
  * such as /home/detchar/Segments/SegmentList_FPMI_UTC_2019-12-17.txt
Line 37: Line 33:
  * [[http://gwwiki.icrr.u-tokyo.ac.jp/JGWwiki/KAGRA/Subgroups/DET/DataQuality#Online_Data_Quality_Vector | definition]]
  * We cbc group should check the second bit is 1.
  * channel name : '''K1:DET-DQ_STATE_VECTOR'''
  * the definition of DQV in full data : [[http://gwwiki.icrr.u-tokyo.ac.jp/JGWwiki/KAGRA/Subgroups/DET/DataQuality#Engineering_Run_with_FPMI_from_17th_to_23rd_Dec. | definition]]
  * the definition of DQV in ll_merged data is same as full data.
Line 40: Line 37:
 * CBC lock segments
  * We checked lock flag of each data and collected the locked data. We considered lock segments by file units for convenience. If compared with [[http://gwwiki.icrr.u-tokyo.ac.jp/JGWwiki/KAGRA/Subgroups/DET/RUN#ER_with_MICH_on_Jul._13 | lock segment(DetChar)]], this lock segment is small slightly.
 * CBC lock segments until '''2019/12/18 JST'''.
  * We checked lock flag of each data and collected the locked data. We considered lock segments by file units for convenience. If compared with [[https://gwdet.icrr.u-tokyo.ac.jp/~controls/summary/day/20191218/#observing|lock segment(DetChar)]], this lock segment is small slightly.
Line 43: Line 40:
  || '''#''' || '''start GPS''' || '''stop GPS''' || '''duration''' ||
  || 1 || 1247024288 || 1247043616 || 19328 ||
/* {{attachment:KAGRA_generalView1_WEB_190326.png|view1|width=240}} */
Line 46: Line 42:
== Off line analysis ==   || '''index''' || '''start GPS''' || '''stop GPS''' || '''duration''' || '''PSD''' || '''comment''' ||
  || 0 || 1260604832 || 1260622368 || 17536|| {{attachment:psd_1260604832_1260622368_1.png | view1 | width=240}} || ||
  || 1 || 1260622976 || 1260649952 || 26976|| {{attachment:psd_1260622976_1260649952_1.png | view1 | width=240}} || ||
  || 2 || 1260650400 || 1260661888 || 11488|| {{attachment:psd_1260650400_1260661888_1.png | view1 | width=240}} || ||
  || 3 || 1260662432 || 1260662752 || 320|| {{attachment:psd_1260662432_1260662752_1.png | view1 | width=240}} || ||
  || 4 || 1260668608 || 1260669600 || 992|| {{attachment:psd_1260668608_1260669600_1.png | view1 | width=240}} || ||
  || 5 || 1260669952 || 1260670272 || 320|| {{attachment:psd_1260669952_1260670272_1.png | view1 | width=240}} || ||
  || 6 || 1260671040 || 1260671456 || 416|| {{attachment:psd_1260671040_1260671456_1.png | view1 | width=240}} || ||
  || 7 || 1260673184 || 1260674656 || 1472|| {{attachment:psd_1260673184_1260674656_1.png | view1 | width=240}} || ||
  || 8 || 1260675200 || 1260682048 || 6848|| {{attachment:psd_1260675200_1260682048_1.png | view1 | width=240}} || ||
  || 9 || 1260688800 || 1260689472 || 672|| {{attachment:psd_1260688800_1260689472_1.png | view1 | width=240}} || ||
  || 10 || 1260752128 || 1260752864 || 736|| {{attachment:psd_1260752128_1260752864_1.png | view1 | width=240}} || ||
  || 11 || 1260754720 || 1260755424 || 704|| {{attachment:psd_1260754720_1260755424_1.png | view1 | width=240}} || ||
  || 12 || 1260757216 || 1260759744 || 2528|| {{attachment:psd_1260757216_1260759744_1.png | view1 | width=240}} || ||
  || 13 || 1260760480 || 1260762240 || 1760|| {{attachment:psd_1260760480_1260762240_1.png | view1 | width=240}} || ||
  || 14 || 1260762688 || 1260771776 || 9088|| {{attachment:psd_1260762688_1260771776_1.png | view1 | width=240}} || ||
  || 15 || 1260774656 || 1260788224 || 13568|| {{attachment:psd_1260774656_1260788224_1.png | view1 | width=240}} || ||
  || 16 || 1260790496 || 1260792032 || 1536|| {{attachment:psd_1260790496_1260792032_1.png | view1 | width=240}} || ||
  || 17 || 1260792672 || 1260796096 || 3424|| {{attachment:psd_1260792672_1260796096_1.png | view1 | width=240}} || ||
  || 18 || 1260796704 || 1260802816 || 6112|| {{attachment:psd_1260796704_1260802816_1.png | view1 | width=240}} || ||



== Offline analysis(yuzurihara) ==
Line 50: Line 69:
 * Check the available locked data '''(done)'''
  * Summarize the data length '''(done)'''
/* '''(done)''' */
Line 53: Line 71:
 * Estimate power spectrum density '''(done)'''
  * Summarize information in pdf '''(done)'''
 * Check the available locked data
  * Summarize the data length
Line 56: Line 74:
 * Generate lock list and segment list '''(done)'''  * Estimate power spectrum density
  * Summarize plots in pdf
Line 58: Line 77:
 * Generate template bank '''(skipped)'''
  * How many waveforms we need? '''(skipped)'''
 * Generate lock list and segment list
Line 61: Line 79:
 * Search signals by matched filter and chi^2 '''(done)'''  * Generate template bank
  * How many waveforms we need?
Line 63: Line 82:
 * Summary the output of search '''(done)'''
  * histogram of SNR '''(done)'''
  * glitch list(GPS, JST, mass, ISCO frequency, duration) '''(done)'''
 * Search signals by matched filter and chi^2

* Summary the output of search
  * histogram of SNR
  * glitch list(GPS, JST, mass, ISCO frequency, duration)
Line 69: Line 90:
 * Summary of locked data [[http://gwwiki.icrr.u-tokyo.ac.jp/JGWwiki/KAGRA/DAWG/CBC/ER2#Data_related | CBC locked segment]]  * Summary of locked data
Line 71: Line 92:
 * Averaged PSD [[https://gwdoc.icrr.u-tokyo.ac.jp/cgi-bin/private/DocDB/ShowDocument?docid=10448 | JGWdoc]]  * Averaged PSD
Line 84: Line 105:
 * Histogram of detection statistics [[https://gwdoc.icrr.u-tokyo.ac.jp/cgi-bin/private/DocDB/ShowDocument?docid=10448 | JGWdoc]]  * Histogram of detection statistics
Line 87: Line 108:
 * Time series of detection statistics [[https://gwdoc.icrr.u-tokyo.ac.jp/cgi-bin/private/DocDB/ShowDocument?docid=10448 | JGWdoc]]  * Time series of detection statistics
Line 97: Line 118:
== Online analysis ==

 * Online matched filtering
  * July 13, 17:08 - 18:00 JST
  * Using low latency data files (1 sec) dumped from shared memory
  * About 1 minutes deley
  * CH: K1:DCS-CALIB_STRAIN_C10
  * Template: (30,30)Msun, no spin, Waveform: IMRPhenomD
  * Used pre-computed PSD
== Online analysis(Tagoshi-san?) ==
Line 114: Line 127:

 * [[http://gwwiki.icrr.u-tokyo.ac.jp/JGWwiki/KAGRA/DAWG/CBC/ER2 | CBC search in ER2]]

Engineering Run 3

Date

  • JST: Dec. 17, 2019, 17:00 -- Dec. 24, 2019, 9:00
  • GPS: 1260604818 -- 1261180818

  • KAGRA full data
    • m31:/data/full : Full KAGRA data
  • Low latency data
    • m31:/data/ll_merged/ : Low latency data packed in 4096 seconds
    • hydra:/data/ll_merged/ : Low latency data packed in 4096 seconds
    • hydra: /data/ll-sharing/shm/llhoft/ : Low latency data (1 second) dumped from shared memory (retained only for 8192 seconds)
  • h(t) channel name
    • full : K1:CAL-CS_PROC_C00_STRAIN_DBL_DQ

    • ll_merged : K1:DCS-CALIB_STRAIN_C10

  • lock flag
    • definition : K1:GRD-LSC_LOCK_STATE_N = 1000

    • Based on this definition, detchar group provides the segment file in m31-01
    • such as /home/detchar/Segments/SegmentList_FPMI_UTC_2019-12-17.txt
  • data quality vector
    • channel name : K1:DET-DQ_STATE_VECTOR

    • the definition of DQV in full data : definition

    • the definition of DQV in ll_merged data is same as full data.
  • CBC lock segments until 2019/12/18 JST.

    • We checked lock flag of each data and collected the locked data. We considered lock segments by file units for convenience. If compared with lock segment(DetChar), this lock segment is small slightly.

  • index

    start GPS

    stop GPS

    duration

    PSD

    comment

    0

    1260604832

    1260622368

    17536

    view1

    1

    1260622976

    1260649952

    26976

    view1

    2

    1260650400

    1260661888

    11488

    view1

    3

    1260662432

    1260662752

    320

    view1

    4

    1260668608

    1260669600

    992

    view1

    5

    1260669952

    1260670272

    320

    view1

    6

    1260671040

    1260671456

    416

    view1

    7

    1260673184

    1260674656

    1472

    view1

    8

    1260675200

    1260682048

    6848

    view1

    9

    1260688800

    1260689472

    672

    view1

    10

    1260752128

    1260752864

    736

    view1

    11

    1260754720

    1260755424

    704

    view1

    12

    1260757216

    1260759744

    2528

    view1

    13

    1260760480

    1260762240

    1760

    view1

    14

    1260762688

    1260771776

    9088

    view1

    15

    1260774656

    1260788224

    13568

    view1

    16

    1260790496

    1260792032

    1536

    17

    1260792672

    1260796096

    3424

    18

    1260796704

    1260802816

    6112

Offline analysis(yuzurihara)

Check point

  • Check the available locked data
    • Summarize the data length
  • Estimate power spectrum density
    • Summarize plots in pdf
  • Generate lock list and segment list
  • Generate template bank
    • How many waveforms we need?
  • Search signals by matched filter and chi^2
  • Summary the output of search
    • histogram of SNR
    • glitch list(GPS, JST, mass, ISCO frequency, duration)

  • Summary of locked data
  • Averaged PSD
    • Power spectrum density (PSD) is averaged over 1 sec chunks by taking median.
  • Calculation time to search for signals
    • Read 500 sec data : < 1 min

    • Estimate PSD : 2~3 min.
    • matched filter+chi^2 with single waveform (not bank) : < 1 min

  • Histogram of detection statistics
    • If data is Gaussian, <snr>=1.

  • Time series of detection statistics
    • waveform : 1.4 - 1.4 Msun
    • Beginning and ending 50 sec data were removed from the result.
    • We uploaded the 3 kinds of time series results which were maximized over rho(matched filter), chi square, rhohat(detection statistics) during 1 second window.
      • We added time series of rho and chi square, because time series of rhohat don't contain the information of the glitch.
    • File names are
      • "cbc_max_rho_ER2.txt" (this data indicates the time when data contains high power)
      • "cbc_max_chi2_ER2.txt" (this data indicates the time when data contains high power in specific frequency band)
      • "cbc_max_rhohat_ER2.txt" (this data indicates the time when data "might" contains gravitational wave signal)

Online analysis(Tagoshi-san?)

  • Plots

KAGRA/DAWG/CBC/ER-Dec-2019 (last edited 2020-01-08 12:59:52 by HirotakaYuzurihara)