Differences between revisions 1288 and 1292 (spanning 4 versions)
⇤ ← Revision 1288 as of 2024-04-24 10:50:57 →
Size: 33832
Editor: HirotakaYuzurihara
Comment:
← Revision 1292 as of 2024-04-24 11:05:54 → ⇥
Size: 33630
Editor: HirotakaYuzurihara
Comment:
Deletions are marked like this. Additions are marked like this.
Line 15: Line 15:
    * KAGRA international workshop (KIW11)@Taiwan: 2023/04/16-17 [[https://indico.phys.sinica.edu.tw/event/92/|web]]
    * Gravitaional wave open data workshop (GWODW7)@Taiwan: 2023/04/18-20 [[https://indico.phys.sinica.edu.tw/event/92/page/220-gravitational-wave-open-data-workshop|web]], [[https://gwosc.org/odw/odw2024/|Info. from GWOSC]]
Line 21: Line 19:
    * Next meeting will be canceled ==> next meeting is 8 May.
Line 28: Line 27:
     * cache file for O3GK and O4a
Line 30: Line 30:
  * Report of KIW and open data workshop#7

Meetings

  • Meeting time: 11:00-11:30 JST/KST on every Wednesday
  • Meeting room: Zoom3

Contents

  1. Meetings
    1. Agenda & Minutes
      1. 20240424 (Wed.)
      2. 20240410 (Wed.)
      3. 20240403 (Wed.)
      4. 20240326 (Wed.)
      5. 20240306 (Wed.)
      6. 20240228 (Wed.)
      7. 20240221 (Wed.)
      8. 20240214 (Wed.)
      9. 20240207 (Wed.)
      10. 20240131 (Wed.)
      11. 20240124 (Wed.)
      12. 20240117 (Wed.)
      13. Past meeting

Agenda & Minutes

20240424 (Wed.)

  • Agenda
    • Announcement
      • O4a/preO4b(not call it as postO4a)/ER16/O4b schedule:
      • Introduction of new comer

      • Next meeting will be canceled ==> next meeting is 8 May.

      • KAGRA site report
    • Progress reports

      • Upgrade DetChar computers (YamaT)

      • DQR update (Yuzurihara)
      • Update contents of summary page (Oshino)
      • Related to segment files (Uchikata, Narikawa)
      • provide the dedicated summary page for O4a of KAGRA (Uchikata and Narikawa)
      • cache file for O3GK and O4a
      • pyCBC trigger list for O4a data (Narikawa and Uchikata)
  • Minutes
    • Report of KIW and open data workshop#7

20240410 (Wed.)

  • Agenda
    • Announcement

      • KAGRA international workshop (KIW11)@Taiwan: 2023/04/16-17 web

      • Gravitaional wave open data workshop (GWODW7)@Taiwan: 2023/04/18-20 web, Info. from GWOSC

      • O4a/preO4b(not call it as postO4a)/ER16/O4b schedule:
      • Introduction of new comer
      • KAGRA site report
    • Progress reports

      • Upgrade DetChar computers (YamaT)

      • DQR update (Yuzurihara)
      • Update contents of summary page (Oshino)
      • Related to segment files (Uchikata, Narikawa)
      • provide the dedicated summary page for O4a of KAGRA (Uchikata and Narikawa)
      • pyCBC trigger list for O4a data (Narikawa and Uchikata)
  • Minutes
    • pyCBC trigger list for O4a data (Narikawa and Uchikata)

      • Use segment information of SCIENCE MODE + IPC glitch ==> ongoing

        • ongoing

      • Change data length 4096s -> 64s. Apply the high pass filter before splitting the data. ==> done

      • Estimate common PSD and use it for the analysis ==> done

      • Is it possible to output the trigger list in xml format?

20240403 (Wed.)

  • Agenda
    • Announcement

      • KAGRA international workshop (KIW11)@Taiwan: 2023/04/16-17 web

      • Gravitaional wave open data workshop (GWODW7)@Taiwan: 2023/04/18-20 web, Info. from GWOSC

      • O4a/preO4b(not call it as postO4a)/ER16/O4b schedule:

      • Update of DQSEGDB server help ticket

      • KAGRA site report
    • Budget request
    • Progress reports

      • Upgrade DetChar computers (YamaT)

      • DQR update (Yuzurihara)
      • Update contents of summary page (Oshino)
      • Related to segment files (Uchikata, Narikawa)
      • provide the dedicated summary page for O4a of KAGRA (Uchikata and Narikawa)
      • pyCBC trigger list for O4a data (Narikawa and Uchikata)
  • Minutes

    • Upgrade DetChar computers (YamaT)

      • waiting the update of workstation machines. I will take a few monthes.
    • DQR update (Yuzurihara)
      • no update.
    • Update contents of summary page (Oshino)
      • no update
    • Hveto (Kyujin)
      • Trouble on KISTI cluster.
    • pyCBC trigger list for O4a data (Narikawa and Uchikata)
      • Use segment information of SCIENCE MODE + IPC glitch

      • Change data length 4096s -> 64s. Apply the high pass filter before splitting the data.

      • Estimate common PSD and use it for the analysis
      • Is it possible to output the trigger list in xml format?

20240326 (Wed.)

  • Agenda
    • Announcement

      • KAGRA international workshop (KIW11)@Taiwan: 2023/04/16-17 web

      • Gravitaional wave open data workshop (GWODW7)@Taiwan: 2023/04/18-20 web, Info. from GWOSC

      • O4a/preO4b(not call it as postO4a)/ER16/O4b schedule:

        • ER16: It will nominally start at 1500 UTC (2400 JST) on 20 Mar 2024, and last for 2 weeks.

        • O4b: We plan to commence O4b at 1500 UTC (2400 JST) on 3 April 2024.

        • Ref.internal discussion, public announcements

      • KAGRA site report
    • Budget request
    • Progress reports

      • Upgrade DetChar computers (YamaT)

      • DQR update (Yuzurihara)
      • Update contents of summary page (Oshino)
      • Related to segment files (Uchikata, Narikawa)
      • provide the dedicated summary page for O4a of KAGRA (Uchikata and Narikawa)
      • pyCBC trigger list for O4a data (Narikawa and Uchikata)
  • Minutes
    • Budget request
      • New computers for replacing too old servers (k1det0, 1): 500k-yen x2
      • HDD for new systems: 10k-yen x10-20
    • Progress reports

      • Upgrade DetChar computers (YamaT)

        • Testing DetChar softwares can be started after the update of CDS workstations is completed.

        • Test of CDS workstation needs more time (hopefully by end of April)
      • DQR update (Yuzurihara)
        • No update
      • Update contents of summary page (Oshino)
        • No update
      • Related to segment files (Uchikata, Narikawa)
        • No update
      • provide the dedicated summary page for O4a of KAGRA (Uchikata and Narikawa)
      • pyCBC trigger list for O4a data (Narikawa and Uchikata)
        • No update

20240306 (Wed.)

  • Agenda
    • Announcement

      • KAGRA international workshop (KIW11)@Taiwan: 2023/04/16-17 web

      • Gravitaional wave open data workshop (GWODW7)@Taiwan: 2023/04/18-20 web, Info. from GWOSC

      • O4a/preO4b(not call it as postO4a)/ER16/O4b schedule:

      • LVK meeting on March 11-14 at Louisiana State University web

        • There is no fee for online participants

      • Update of member list for DetChar mailing list

      • KAGRA site report
    • Task list for the authorship 2024
    • Progress reports
      • O4a summary page(Uchikata)
        • After several attempts, the job was finished without errors. Another small problems,

20240228 (Wed.)

  • Agenda
    • Announcement

      • KAGRA international workshop (KIW11)@Taiwan: 2023/04/16-17 web

      • Gravitaional wave open data workshop (GWODW7)@Taiwan: 2023/04/18-20 web, Info. from GWOSC

      • O4a/preO4b(not call it as postO4a)/ER16/O4b schedule:

      • LVK meeting on March 11-14 at Louisiana State University web

        • Early Registration is open until February 1
        • There is no fee for online participants

      • Update of member list for DetChar mailing list

      • KAGRA site report
    • Task list for the authorship 2024
    • Progress reports
  • Minutes
    • Task list for the authorship 2024 (not fixed yet) 
      1. Commissioning support : serving data monitoring tools for site commissioners.
  This task focuses on the support of the IFO lock trial and/or noise hunting based on the request from the interferometer commissioners.
  Support of analyses to measured data (e.g. noise projection to the DARM with measured noise and TFs) is also contained in this task.
  Specialized tasks for each subgroup should be applied for in the respective group task.

2. Production and validation of Online Data Quality State Vector (for O4b/O5 preparation.
  This task focusing on providing the online DetChar products such as the online DQSV and managing various reliable online flags.
  Developing real-time and guardian codes for providing such flags should be contained in this task.

3. Production and validation of Segment information for O4b/O5 preparation.
  This task focusing on providing low-latency/offline segments.
  Providing segment itself, evaluation of efficient channels to make segments, evaluating benefit of segments on GW searches
  and cooperation with CIT staffs to update segment contents on DQSEGDB are contained in this task.

4. Construction of DQR (Data Quality Report) and igwn-alert framework for O4b/O5 RRT activities.
  This task focusing on providing contents from KAGRA to DQR web pages which is merged with LIGO, Virgo and KAGRA.

5. Support of Data Analysis group to set Data Category criteria for O4b/O5 joint observing run.
  This task focusing on the support of the GW-search activities based on the each WG of DAC.
  Providing data category for the pipelines of each GW sources, providing veto segments 
  and other noise information such as identified spectral lines are also contained in this task.

6. Managing DET computers and their environments.
  This task contains the computer environment construction for providing the DetChar products in the cadence of online/low-latency/offline.
  Managing dedicated servers for sharing DetChar products among LVK is also contained in this task.

=====
- Noise hunting in KAGRA commissioning.
    Obsolescent 
    Noise *hunting* without IFO (hardware) experts is unrealistic.
    In this meaning, the most of noise *hunting* can be covered in "Commissioning support”.
    If the tasks are related to the noise *finding* for the purpose of providing veto segment,
    they can be covered in “Support of Data Analysis”.
      • hveto analysis is contained in 1. in the case that there is some communication with onsite commissioners via klog etc.
        • It's also potentially contained in 5. in the case of providing veto-ed segments, correlated channels etc.

      • Providing Run SummaryPage is contained in 5.

        • Exact sentence as "Making Run Summary" should be added the description in 5.
    • Progress reports
      • Unify conda environment in Kamioka detchar computers, k1sum[01] and k1det[012] (YamaT)
        • start consideration about the system upgrade to new Debian system.
        • DET tools depend on the CDS tools and CDS tools are well managed on apt-repository.
        • Only a part of CDS tools can be available on Anaconda now.
      • DQR update (Yuzurihara)
      • Update contents of summary page (Oshino)
      • Combine DET computer resources into one DET cluster at Kamioka site
      • Related to segment files (Uchikata, Narikawa)

      • provide the dedicated summary page for O4a of KAGRA (Uchikata and Narikawa) O4a (LV)

      • pyCBC trigger list for O4a data (Narikawa and Uchikata) O4a (H1)

        • 4000s data analysis is ongoing.
          • Processed time is a few hours
        • Used template is changed from BBH to BNS.
          • Trigger behavior is changed by used templates.
        • Generated triggers are in the text format.

          • If LIGO's XML (LW XML?) is available, it may be very easy to make various plots on SummaryPages.

20240221 (Wed.)

  • Agenda
    • Announcement

      • KAGRA international workshop (KIW11)@Taiwan: 2023/04/16-17 web

      • Gravitaional wave open data workshop (GWODW7)@Taiwan: 2023/04/18-20 web

      • O4a/preO4b(not call it as postO4a)/ER16/O4b schedule:

      • LVK meeting on March 11-14 at Louisiana State University web

        • Early Registration is open until February 1
        • There is no fee for online participants

      • Update of member list for DetChar mailing list

      • KAGRA site report (Yuzurihara)
    • Commissioning support + tasks related to O4a
      • O4a for KAGRA : 2023/05/25 0:00 JST (=2023/05/24 15:00UTC) ~ 2023/06/21 8:00 JST
      • Event validation (YamaT)
      • Online data quality state vector (YamaT)
      • Tool to evaluate Gaussianity (Yamamura)
      • Scattered light noise (Yamamura)
      • Pastavi update (Yuzurihara)
      • Noise hunting by machine learning and Hveto (Kyujin, Kihyun, Syifa)
      • Classification of glitch noise (Shikano, Oshino)
      • IPC glitch
      • line noise study (Samurai)
    • Unify conda environment in Kamioka detchar computers, k1sum[01] and k1det[012] (YamaT)
    • DQR update (Yuzurihara)
    • Update contents of summary page (Oshino)
    • Combine DET computer resources into one DET cluster at Kamioka site
    • Related to segment files (Uchikata, Narikawa)

    • provide the dedicated summary page for O4a of KAGRA (Uchikata and Narikawa) O4a (LV)

    • pyCBC trigger list for O4a data (Narikawa)
  • Minutes

20240214 (Wed.)

  • Agenda
    • Announcement

      • KAGRA international workshop (KIW11)@Taiwan: 2023/04/16-17 web

      • Gravitaional wave open data workshop (GWODW7)@Taiwan: 2023/04/18-20 web

      • O4a/preO4b(not call it as postO4a)/ER16/O4b schedule:

      • White paper and task list for 2024 git repo

      • LVK meeting on March 11-14 at Louisiana State University web

        • Early Registration is open until February 1
        • There is no fee for online participants

      • Update of member list for DetChar mailing list

      • KAGRA site report (Yuzurihara)
    • Commissioning support + tasks related to O4a
    • Unify conda environment in Kamioka detchar computers, k1sum[01] and k1det[012] (YamaT)
    • DQR update (Yuzurihara)
    • Update contents of summary page (Oshino)
    • Combine DET computer resources into one DET cluster at Kamioka site
    • Related to segment files (Uchikata, Narikawa)

    • provide the dedicated summary page for O4a of KAGRA (Uchikata and Narikawa) O4a (LV)

    • pyCBC trigger list for O4a data (Narikawa)
  • Minutes
    • Online data quality state vector (YamaT)
    • Scattered light noise (Yamamura)

      • Investigation of scattered light noise in O4a

      • (oshino) why the double bounce occurred?
      • (yamaT) it's better to check both the feedback and error signal (OUT_DQ and IN1_DQ).
      • (oshino) PD signal might be helpful in the investigation. In POP_FORWARD, the scattered light was seen in the past.
    • Noise hunting by machine learning and Hveto (Kyujin, Kihyun, Syifa)

      • KAGRA O4a hveto results (0524 ~ 0606) KAGRA O4a hveto results (0607 ~ 0619)

      • hveto shows the many triggers on the time the scattered light noise appeared
      • (yamaT) IPC glitch was taken care in this analysis? It's better to use SCIENCE segment + IPC glitch segment.
      • It is interesting to compare the glitch rate and the analysis result with and without IPC glitch segments.
      • Yuzurihara shared that segment with Kihyun.

    • provide the dedicated summary page for O4a of KAGRA (Uchikata and Narikawa) O4a (LV)

    • pyCBC trigger list for O4a data (Narikawa)
      • (yamaT) can we include the trigger information by pycbc, in the summary page?

20240207 (Wed.)

  • Agenda
    • Announcement

      • KAGRA international workshop (KIW11)@Taiwan: 2023/04/16-17 web

      • Gravitaional wave open data workshop (GWODW7)@Taiwan: 2023/04/18-20 web

      • O4a/preO4b(not call it as postO4a)/ER16/O4b schedule:

      • White paper and task list for 2024 git repo

      • LVK meeting on March 11-14 at Louisiana State University web

        • Early Registration is open until February 1
        • There is no fee for online participants

      • Update of member list for DetChar mailing list

      • KAGRA site report (Yuzurihara)
    • Commissioning support + tasks related to O4a
      • O4a for KAGRA : 2023/05/25 0:00 JST (=2023/05/24 15:00UTC) ~ 2023/06/21 8:00 JST
      • Event validation (YamaT)
      • Online data quality state vector (YamaT)
      • Tool to evaluate Gaussianity (Yamamura)
      • Scattered light noise (Yamamura)
      • Pastavi update (Yuzurihara)
      • Noise hunting by machine learning and Hveto (Kyujin, Kihyun, Syifa)
      • Classification of glitch noise (Shikano, Oshino)
      • IPC glitch
      • line noise study (Samurai)
    • Unify conda environment in Kamioka detchar computers, k1sum[01] and k1det[012] (YamaT)
    • DQR update (Yuzurihara)
    • Update contents of summary page (Oshino)
    • Combine DET computer resources into one DET cluster at Kamioka site
    • Related to segment files (Uchikata, Narikawa)

    • Provide the dedicated summary page for O4a of KAGRA (Uchikata) O4a (LV)

  • Minutes
    • Online data quality state vector (YamaT)

      • model update of k1detdq0 This is bug fix of production of online data quality state vector related to DAC saturation.

      • The hardware test will be done this week an next week.
    • Tool to evaluate Gaussianity (Yamamura)
    • Classification of glitch noise (Shikano, Oshino)
      • They restarted this project. The report will be done soon.

    • Provide the dedicated summary page for O4a of KAGRA (Uchikata) O4a (LV)

      • They tested the conda environment and configuration files for the production of the summary page. Except for the specific short time, they can generated the O4a summary page including duty cycle and inspiral range.
    • Generation of trigger list by pycbc (Narikawa)
      • Code test is ongoing by using the short 4096s data of O4a. The timeseries of chi square looks strange. They plan to apply the high pass filter, instead of window function.
      • (yamat) How do you decide clustering length?
      • (Narikawa) By software injection, we can evaluate how the SNR spreads and determine the clustering length.

20240131 (Wed.)

  • Agenda
    • Announcement

      • KAGRA international workshop (KIW11)@Taiwan: 2023/04/16-17 web

      • Gravitaional wave open data workshop (GWODW7)@Taiwan: 2023/04/18-20 web

      • O4a/preO4b(not call it as postO4a)/ER16/O4b schedule:

      • White paper and task list for 2024 git repo

      • LVK meeting on March 11-14 at Louisiana State University web

        • Early Registration is open until February 1
        • There is no fee for online participants

      • Update of member list for DetChar mailing list

      • LVK MoA survey summary LIGO DCC

      • KAGRA site report (Yuzurihara)
    • Commissioning support + tasks related to O4a
      • O4a for KAGRA : 2023/05/25 0:00 JST (=2023/05/24 15:00UTC) ~ 2023/06/21 8:00 JST
      • Event validation (YamaT)
      • Tool to evaluate Gaussianity (Yamamura)
      • Scattered light noise (Yamamura)
      • Pastavi update (Yuzurihara)
      • Noise hunting by machine learning and Hveto (Kyujin, Kihyun, Syifa)
      • Classification of glitch noise (Shikano, Oshino)
      • IPC glitch
      • line noise study (Samurai)
    • Unify conda environment in Kamioka detchar computers, k1sum[01] and k1det[012] (YamaT)
    • DQR update (Yuzurihara)
    • Update contents of summary page (Oshino)
    • Combine DET computer resources into one DET cluster at Kamioka site
    • Related to segment files (Uchikata, Narikawa)

    • provide the dedicated summary page for O4a of KAGRA (Uchikata and Narikawa) O4a (LV)

  • Minutes
    • Noise hunting by machine learning and Hveto (Kyujin, Kihyun, Syifa)
    • line noise study (Samurai)

      • slide

      • Is it possible to set the initial parameter in advance, such as prominence and height?
      • In future, it is better to extend the fft length to be longer for fine frequency resolution.
    • Update contents of summary page (Oshino)
    • Related to segment files (Uchikata, Narikawa)

    • provide the dedicated summary page for O4a of KAGRA (Uchikata and Narikawa) O4a (LV)

      • The attempt to generate summary page is on system-B. For reading data, NDS2 server is helpful.

20240124 (Wed.)

  • Agenda
    • Announcement
      • KAGRA international workshop (KIW11)@Taiwan: 2023/04/16-17

      • Gravitaional wave open data workshop (GWODW7)@Taiwan: 2023/04/18-20 web

      • LIGO-Virgo-KAGRA detchar joint meeting
        • tileslot: onthly, 23:00 JST (14:00 UTC) or 6:00 JST (21 UTC)

        • Last meeting on Nov. 15 23:00 JST (14:00 UTC) wiki

      • O4a/preO4b(not call it as postO4a)/ER16/O4b schedule:

        • O4a: It will end at 1600 UTC on 16 Jan 2024. LLO will end O4a observing early, at 1400 UTC.

        • ER16: It will nominally start on 13 Mar 2024, and last for 2 weeks. (Note that ER16 will begin in the middle of the next LVK meeting at LSU, 11-14 March.)

        • O4b: We plan to commence O4b at 1600 UTC (2500 JST) on 27 Mar 2024.

        • Ref.internal short announcements (reminders), public announcements

      • Information of O4a wiki page

      • White paper and task list for 2024 git repo

      • LVK meeting on March 11-14 at Louisiana State University

      • Update of member list for DetChar mailing list

      • KAGRA site report (Yuzurihara)
    • Commissioning support + tasks related to O4a
      • O4a for KAGRA : 2023/05/25 0:00 JST (=2023/05/24 15:00UTC) ~ 2023/06/21 8:00 JST
      • Event validation (YamaT)
      • Tool to evaluate Gaussianity (Yamamura)
      • Scattered light noise (Yamamura)
      • Pastavi update (Yuzurihara)
      • Noise hunting by machine learning and Hveto (Kyujin, Kihyun, Syifa)
      • Classification of glitch noise (Shikano, Oshino)
      • IPC glitch
      • line noise study (Samurai)

        • Peak identifications web

    • Unify conda environment in Kamioka detchar computers, k1sum[01] and k1det[012] (YamaT)
    • DQR update (Yuzurihara)
    • Update contents of summary page (Oshino)
      • run Omicron at Kamioka site and refresh the Omicron plots on summary page during O4a period
    • Combine DET computer resources into one DET cluster at Kamioka site
    • Script to generate segment files (Uchikata, Narikawa)
    • Related to segment files (Uchikata, Narikawa)

    • provide the dedicated summary page for O4a of KAGRA? O3a (LV)

  • Minutes

20240117 (Wed.)

  • Agenda
    • Announcement
      • KAGRA international workshop (KIW11)@Taiwan: 2023/04/16-17

      • Gravitaional wave open data workshop (GWODW7)@Taiwan: 2023/04/18-20 web

      • LIGO-Virgo-KAGRA detchar joint meeting
        • tileslot: onthly, 23:00 JST (14:00 UTC) or 6:00 JST (21 UTC)

        • Last meeting on Nov. 15 23:00 JST (14:00 UTC) wiki

      • O4a/preO4b(not call it as postO4a)/ER16/O4b schedule:

        • O4a: It will end at 1600 UTC on 16 Jan 2024. LLO will end O4a observing early, at 1400 UTC.

        • ER16: It will nominally start on 13 Mar 2024, and last for 2 weeks. (Note that ER16 will begin in the middle of the next LVK meeting at LSU, 11-14 March.)

        • O4b: We plan to commence O4b at 1600 UTC (2500 JST) on 27 Mar 2024.

        • Ref.internal short announcements (reminders), public announcements

      • Information of O4a wiki page

      • White paper and task list for 2024 git repo

      • LVK meeting on March 11-14 at Louisiana State University
      • KAGRA site report (Yuzurihara)
    • Commissioning support + tasks related to O4a
      • O4a for KAGRA : 2023/05/25 0:00 JST (=2023/05/24 15:00UTC) ~ 2023/06/21 8:00 JST
      • Event validation (YamaT)
      • Tool to evaluate Gaussianity (Yamamura)
      • Scattered light noise (Yamamura)
      • Pastavi update (Yuzurihara)
      • Noise hunting by machine learning and Hveto (Kyujin, Kihyun, Syifa)
      • Classification of glitch noise (Shikano, Oshino)
      • IPC glitch
      • line noise study (Samurai)

        • Peak identifications web

    • Unify conda environment in Kamioka detchar computers, k1sum[01] and k1det[012] (YamaT)
    • DQR update (Yuzurihara)
    • Update contents of summary page (Oshino)
      • run Omicron at Kamioka site and refresh the Omicron plots on summary page during O4a period
    • Combine DET computer resources into one DET cluster at Kamioka site
    • Script to generate segment files (Uchikata, Narikawa)
    • Related to segment files (Uchikata, Narikawa)

    • provide the dedicated summary page for O4a of KAGRA? O3a (LV)

  • Minutes

Past meeting

KAGRA/Subgroups/DET/Meeting (last edited 2024-11-05 14:02:03 by HirotakaYuzurihara)