Differences between revisions 443 and 1280 (spanning 837 versions)
⇤ ← Revision 443 as of 2022-04-11 13:47:13 →
Size: 18191
Editor: HirotakaYuzurihara
Comment:
← Revision 1280 as of 2024-04-03 10:51:08 → ⇥
Size: 30574
Editor: HirotakaYuzurihara
Comment:
Deletions are marked like this. Additions are marked like this.
Line 2: Line 2:
  * Meeting time: 13:00-13:30 JST/KST on every Monday
  * Meeting room: Zoom		   * Meeting time: 11:00-11:30 JST/KST on every Wednesday
  * Meeting room: Zoom3
Line 11: Line 11:
=== 20220411 (Mon.) ===
 * Agenda
   * Announcement
    * Workshop 2022/04/15 [[https://indico.in2p3.fr/event/26414/program|web page]]
     * DetChar talk is planed by Yokozawa. When he circulates slide, put comments on slide.
   * Unify conda environment in Kamioka detchar computers, k1sum[01] and k1det[012]
    * call for volunteers from remote site, to test hveto and FScan. Please let us (Yuzuriahra or YamaT) know.
   * Exchange of opinions between DET members(YamaT, Sawada(OPS), Yuzurihara) and DMG members(Kanda, Oohara)
   * DQR update (Yuzurihara)
   * Update contents of summary page? (Oshino)
   * Combine DET computer resources into one DET cluster at Kamioka site
    * (Oshino) explain idea, goal, and timeline
   * Report of new tool development? (Darkhan)
   * Follow-up report of remote contribution from Aoyama Gakuin univ.		 === 20240403 (Wed.) ===
 * Agenda
   * Announcement
    * KAGRA international workshop (KIW11)@Taiwan: 2023/04/16-17 [[https://indico.phys.sinica.edu.tw/event/92/|web]]
    * Gravitaional wave open data workshop (GWODW7)@Taiwan: 2023/04/18-20 [[https://indico.phys.sinica.edu.tw/event/92/page/220-gravitational-wave-open-data-workshop|web]], [[https://gwosc.org/odw/odw2024/|Info. from GWOSC]]
    * O4a/preO4b(not call it as postO4a)/ER16/O4b schedule:
     * '''ER16''': It will nominally start at 1500 UTC (2400 JST) on '''20 Mar 2024''', and last for 2 weeks.
     * '''O4b''': We plan to commence O4b at 1500 UTC (2400 JST) on '''3 April 2024'''.
     * Ref.[[https://wiki.ligo.org/Operations/Agenda240321|internal discussion]], [[https://observing.docs.ligo.org/plan/|public announcements]]
    * Update of DQSEGDB server [[https://git.ligo.org/computing/helpdesk/-/issues/5672|help ticket]]
    * KAGRA site report
   * Budget request
   * Progress reports
     * Upgrade DetChar computers (YamaT)
     * DQR update (Yuzurihara)
     * Update contents of summary page (Oshino)
     * Related to segment files (Uchikata, Narikawa)
     * provide the dedicated summary page for O4a of KAGRA (Uchikata and Narikawa)
     * pyCBC trigger list for O4a data (Narikawa and Uchikata)


-----
=== 20240326 (Wed.) ===
 * Agenda
   * Announcement
    * KAGRA international workshop (KIW11)@Taiwan: 2023/04/16-17 [[https://indico.phys.sinica.edu.tw/event/92/|web]]
    * Gravitaional wave open data workshop (GWODW7)@Taiwan: 2023/04/18-20 [[https://indico.phys.sinica.edu.tw/event/92/page/220-gravitational-wave-open-data-workshop|web]], [[https://gwosc.org/odw/odw2024/|Info. from GWOSC]]
    * O4a/preO4b(not call it as postO4a)/ER16/O4b schedule:
     * '''ER16''': It will nominally start at 1500 UTC (2400 JST) on '''20 Mar 2024''', and last for 2 weeks.
     * '''O4b''': We plan to commence O4b at 1500 UTC (2400 JST) on '''3 April 2024'''.
     * Ref.[[https://wiki.ligo.org/Operations/Agenda240321|internal discussion]], [[https://observing.docs.ligo.org/plan/|public announcements]]
    * KAGRA site report
   * Budget request
   * Progress reports
     * Upgrade DetChar computers (YamaT)
     * DQR update (Yuzurihara)
     * Update contents of summary page (Oshino)
     * Related to segment files (Uchikata, Narikawa)
     * provide the dedicated summary page for O4a of KAGRA (Uchikata and Narikawa)
     * pyCBC trigger list for O4a data (Narikawa and Uchikata)
Line 26: Line 52:
   * Unify conda environment in Kamioka detchar computers, k1sum[01] and k1det[012]
     * no volunteer yet (Test of hveto and FScan).
       * Coding kagradata.py for the new version of Bruco is ongoing.
       * We need to decide KAGRA common rule about NDS2 and DATAFIND for fixing codes.
     * NAPT test was started for the purpose of saving number of IP address in DGS network.
       * DET gateway (copy of k1gate is enough for the test) will be connected to DGS network.
         * Other nodes will be under DET gateway.
       * It may be better to construct the gateway as Deb10. (Copy of k1gate is Rocky8)
         * TY have no experience of constructing NAPT on Debian.
       * NDS(k1nds[012]), NFS(k1nfs0) services must be available from under DET gateway.
       * How should we do k1det2 which is used for Bruco running from CDS workstation.
   * Exchange of opinions between DET members(YamaT, Sawada(OPS), Yuzurihara) and DMG members(Kanda, Oohara)
    * related to conda environment and DQR tasks
    * in Kashiwa server and Kamioka computers, we should have common rule fo NDS2 and DATAFIND, which YamaT already mentioned.
   * DQR update (Yuzurihara)
    * the application to connect between igwn-alert and Task Manager was developped by Joe
    * DQRAlert [[https://git.ligo.org/o4-dqr/dqralert|git repo]]
    * I tried to run this tool in Kamioka computer and it is working well.
    * need to prepare the document of how to use this tool on wiki page.
    * [[https://git.ligo.org/o4-dqr/dqralert/-/blob/trunk/docs/source/overview.rst|DQR workflow]]
   * Update contents of summary page?
    * no update
   * Combine DET computer resources into one DET cluster at Kamioka site
    * goal : prepare job management server and can submit job to k1det[012]
    * timeline : before O4
    * there might be conflict between this cluster and NAPT test. Oshino and YamaT will discuss.
   * Follow-up report of remote contribution from Aoyama Gakuin univ.
    * (Yokozawa, Oshino, Yuzurihara) we started the discussion of task list and how to contribute from remote site.
-----
=== 20220404 (Mon.) ===
  * Agenda
    * Announcement
     * DQR design document, put comments on [[https://git.ligo.org/detchar/o4-data-quality-report-design-document/-/issues?label_name%5B%5D=Second+circulation|git issue]]
     * Workshop 2022/04/15
      * [[https://indico.in2p3.fr/event/26414/program|Workshop on the development of innovative tools for new collaborations within gravitational wave detection experiments]]
     * KAGRA's authorship submission. For details, see [kagra 05009]. Deadline April 8 17:00 JST
    * Unify conda environment in Kamioka detchar computers, k1sum[01] and k1det[012]
    * DQR update
    * Update of summary page
    * Trouble of Omicron trigger generation
    * 120Hz glitches investigation during O3GK
  * Minutes
    * Unify conda environment in Kamioka detchar computers, k1sum[01] and k1det[012]
      * Installation of IGWN was done on k1detfs.
        * Too slow HDD response? (~150KB/s via NFS)
      * Works well
        * SummaryPages as GPS-select mode
          * ini-file grammar is slightly changed from the old version.
        * Omicron
          * No special hack
        * Omega-scan
          * needs temporal code hack
        * Bruco
          * needs preparation for reading kagra data (kagradata.py)
          * No {{{--include}}} option in original one.
      * Not yet
        * SummaryPages as Daily mode (This will be done by Kamioka people)
        * hveto
        * FScan
          * Not included in IGWN environment?
      * Problem
        * No global NDS2, DataFind servers or equivalent way.
          * SSH port forwarding is not enough because port number is different depending on person.
          * So I cannot do the code hack on IGWN software in the system region.
        * KAGRA env may not be able to be included in IGWN until O4.
          * If so, we shouldn't use IGWN in officially for O4.
     * (Lupin) igwn-py38? or py39?
     * YamaT asked status of FScan
     * In future, we need to prepare similar environment on Kashiwa cluster. The environment is not completely same as Kamioka computers.
     * We need volunteers from remote site, to test hveto and FScan. Please let us (Yuzuriahra or YamaT) know.
    * DQR update (Yuzurihara)
     * Operation test for new version of Task Manager is on-going on k1det1.
     * I found that code of stationary task uses `datafind` to read gwf data, which we don't have.
     * I need to consider how to read data for DQR tasks.
      * (Darkhan) Is there any way to get the latest list of channels?
      * (Yuzurihara) If you can specify the name of frame data, there is a function on gwpy.
    * Update of summary page (Oshino)
     * no update
    * Trouble of Omicron trigger generation (Oshino)
     * [[https://klog.icrr.u-tokyo.ac.jp/osl/?r=20328|klog#20328]]
     * replaced the local SSD on k1sum1. The Omicron triggers are stored in different disk.
    * 120Hz glitches investigation during O3GK
     * no update
     * Kihyun can't join for a while. This project will be postponed.
    * Report of new tool development (Darkhan)
     * showed demonstration
     * this tool can take a ratio between channels and will be able to apply time-domain filter (band pass/highpass/lowpass) in future.
-----
=== 20220328 (Mon.) ===
  * Agenda
    * Announcement
     * DQR design document, put comments on [[https://git.ligo.org/detchar/o4-data-quality-report-design-document/-/issues?label_name%5B%5D=Second+circulation|git issue]]
     * Workshop 2022/04/15 [[https://indico.in2p3.fr/event/26414/program|Workshop on the development of innovative tools for new collaborations within gravitational wave detection experiments]]
    * Unify conda environment in Kamioka detchar computers, k1sum[01] and k1det[012]
    * Activity report by students from Aoyama Gakuin univ.
     * glitch investigation related to IMMT1 oplev (Aoyama Gakuin univ.)
     * Tcam image analysis to identify mirror location and center (Aoyama Gakuin univ.)
    * DQR update
    * Update of summary page
    * 120Hz glitches investigation during O3GK

 * Minutes
  * Unify conda environment in Kamioka detchar computers, k1sum[01] and k1det[012]
   * YamaT constructed the test environment in local computer
   * Although YamaT is copying the environment to DetChar computers, it is very slow. (speed ~ 250KB/s)
   * After copying, YamaT will work on modification of codes to fit KAGRA data, such as nds2.py
   * For testing the tools (Omicron, Hveto...), we need volunteers, especially remote site!
  * Activity report by students from Aoyama Gakuin univ.
   * five students and two staff members from Aoyama Gakuin univ. stayed Kamioka site during last three weeks.
   * They helped commissioning work both in tunnel [[https://klog.icrr.u-tokyo.ac.jp/osl/?r=20124|klog#20124]] [[https://klog.icrr.u-tokyo.ac.jp/osl/?r=20155|klog#20155]] and in control room.
   * several code developments to understand glitch cause have been done. [[https://klog.icrr.u-tokyo.ac.jp/osl/?r=20026|klog#20026]] [[https://klog.icrr.u-tokyo.ac.jp/osl/?r=20027|klog#20027]]
   * code development to identify mirror center of ITMX have been done by using image analysis. [[https://gwdoc.icrr.u-tokyo.ac.jp/cgi-bin/private/DocDB/ShowDocument?docid=14003|slide(Japanese)]] [[https://klog.icrr.u-tokyo.ac.jp/osl/?r=20036|klog#20036]] [[https://klog.icrr.u-tokyo.ac.jp/osl/?r=20198|klog20198]] [[https://klog.icrr.u-tokyo.ac.jp/osl/?r=20203|klog#20203]]
  * DQR update
   * Joe updated Task Manager. Yuzurihara will install new version and test it.
  * Update of summary page
   * no update
  * 120Hz glitches investigation during O3GK
   * no update

-----
=== 20220307 (Mon.) ===
  * Agenda
    * announcement
     * LVK meeting March 2022 [[https://wiki.ligo.org/LSC/Meeting/LVKMeetingMarch2022|wiki]] [[https://cgca.uwm.edu/events/2021lvk|web]]
      * registration is available
    * 120Hz glitches investigation during O3GK
    * unify conda environment in Kamioka detchar computers, k1sum[01] and k1det[012]
    * DQ flags for O4
    * DQR update
    * glitch investigation related to IMMT1 oplev
 * Minutes
    * 120Hz glitches investigation during O3GK
     * no update
    * unify conda environment in Kamioka detchar computers, k1sum[01] and k1det[012]
     * YamaT is working on this project at test-server.
     * Test of new conda environment will start from next week (after JPS meeting)
    * DQ flags for O4
     * no update
    * DQR update
     * Joe is developing the code to connect between igwn-alert and TaskManager. It will be available soon.
     * Schedule for review
      * Review of Task Manager will be done before review of each task.
      * High priority task needs to complete before Aug. 2022
      * Low priority task needs to complete before Nov. 2022
    * glitch investigation related to IMMT1 oplev
     * From March 8, students from Aoyama Gakuin univ. stayed at Kamioka
     * They worked on the investigation of glitch. [[https://klog.icrr.u-tokyo.ac.jp/osl/?r=20026|klog#20026]][[https://klog.icrr.u-tokyo.ac.jp/osl/?r=20027|klog#20027]]
     * They checked IMMT1 QPD signals and PRM suspension signals at the time of glitch.
    * NDS2 tool development (Darkhan)
     * no major update.
    * GPS accuracy monitor (Oshino)
     * is available on [[https://gwdet.icrr.u-tokyo.ac.jp/~controls/summary/day/20220313/detchar/gps/|summary page]]
     * Current difference is acceptable and reasonable.
    * No meeting on March 21 due to Japanese holiday. Next meeting is planed on March 28.

-----
=== 20220307 (Mon.) ===
  * Agenda
    * announcement
     * RRT plan during O4 [[https://dcc.ligo.org/G2200220|slide]]
     * LVK meeting March 2022 [[https://wiki.ligo.org/LSC/Meeting/LVKMeetingMarch2022|wiki]] [[https://cgca.uwm.edu/events/2021lvk|web]]
      * registration is available
    * 120Hz glitches investigation during O3GK
    * unify conda environment in Kamioka detchar computers, k1sum[01] and k1det[012] (YamaT)
    * DQ flags for O4
    * DQR update
  * Minutes (Yuzurihara)
   * 120Hz glitches investigation during O3GK
    * no update
   * unify conda environment in Kamioka detchar computers, k1sum[01] and k1det[012] (YamaT)
    * There are many computers/workstations in Kamioka site or Kamioka control room.
    * Workstations (k1ctr*) use common conda environment by mounting the file server.
    * In DetChar computers k1{sum,det}[01], conda environment should be unified all DetChar resources, similar to workstations.
    * To prevent the trouble that DetChar experts might break the environment, the conda environments will be set as read-only permission.
    * Installation will be done by Kamioka members. After that, we need volunteers to test the DetChar tools on new conda environment.
    * what is the time line?
     * Installation will finished before the end of March. From April, the test will start. Volunteers are helpful.
   * DQ flags for O4
    * In last PEM meeting, Yuzurihara presented the current status and received the helpful comments. [slide](https://gwdoc.icrr.u-tokyo.ac.jp/cgi-bin/private/DocDB/ShowDocument?docid=13970)
    * We will change our plan to construct the data quality flag and will compute the BLRMS of gwpy to set the threshold.
    * The review is necessary before O4. (probably very close to O4, because we need ER)
   * DQR update
    * no update
   * Commissioning of GreenX
    * In the last weekend, the commissioner tried continuous GreenX. During that trials, they found many short term lock loss (~10 ms). 10 ms is too short to follow the suspension motion, so it is likely that there are some causes of the lock loss except for the suspension motion.
    * The commissioner needs helps DetChar members to identify the cause or give a hint of the cause.
    * For details, see [[https://klog.icrr.u-tokyo.ac.jp/osl/index.php?r=19963|klog#19963]] [[https://klog.icrr.u-tokyo.ac.jp/osl/index.php?r=19983|klog#19983]]
    * main channel K1:TMS-X_GR_PDA1_OUT_DQ
    * time : 2022 Mar 06 23:37:50 UTC = 2022 Mar 07 8:37:50 JST = GPS time 1330645088


-----
=== 20220228 (Mon.) ===
  * Agenda
    * 120Hz glitches
    * DQ flags for O4
    * progress of DQR
    * lock loss study of GreenX

  * Minutes (Yuzurihara)
    * accouncement
     * LVK meeting March 2022 [[https://wiki.ligo.org/LSC/Meeting/LVKMeetingMarch2022|wiki]] [[https://cgca.uwm.edu/events/2021lvk|web]]
      * registration is available
      * Wed, 17 March 2021:
       * Plenary Session #1 (09:00-10:30 US/CDT) (=3/16 23:00 JST)
       * Paper Presentation Session #1
       * Plenary Session #2 (16:00-17:30 US/CDT) (=3/17 6:00 JST)
      * Thu, 18 March 2021:
       * Plenary Session #3 (09:00-10:30 US/CDT) (=3/17 23:00 JST)
       * Paper Presentation Session #2
       * Plenary Session #4 (16:00-17:30 US/CDT) (=3/18 6:00 JST)
     * Pastavi server will be unavailable tonight
       * [[https://klog.icrr.u-tokyo.ac.jp/osl/?r=19913|klog#19913]]
    * 120Hz glitches
     * no update
    * DQ flags for O4
     * no update
    * progress of DQR
     * igwn-alert is running more than 9days and receiving the MDC alert
     * next step is to connect the MDC alert with the launch TaskManager.
     * remained task is to develop InspiralRange [[https://git.ligo.org/detchar/dqrtasks/-/issues/8|issue]]
    * lock loss study of GreenX
     * [[https://klog.icrr.u-tokyo.ac.jp/osl/?r=19906|klog#19906]]
     * From the Hveto result, the channel (K1:IMC-SERVO_MIXER_DAQ_OUT_DQ) was the most coincident channel with the lock loss of GreenX.
    * unify the detchar computing environment (YamaT)
     * scattered codes and applications (Omicron, summary page, ) over Kamioka computers are troubling.
     * we plan to unify the environment by using igwn conda
     * detail will be reported in next meeting
     * (Darkhan) conda environment on k1ctr*. someone accidentally update someone's conda environment. administrator should prepare the conda environment?
     * (YamaT) k1ctr* share the environment. this activity is not related to k1ctr* but k1sum[01], k1det[012]. we should separate the user environment and the environment for the DET tools
     * (Darkhan) should avoid accidental mistake.

-----
=== 20220221 (Mon.) ===
  * Agenda
    * 120Hz glitches
    * DQ flags for O4
    * progress of DQR

  * Minutes
    * 120Hz glitches
      * No updates
    * DQ flags for O4
      * No updates
    * progress of DQR
      * [[https://klog.icrr.u-tokyo.ac.jp/osl/?r=19847|klog#19847]]
    * Proposal new tool to see past data by NDS (Darkhan)

-----
=== 20220207 (Mon.) ===
  * Agenda
    * 120Hz glitches
    * Report from [[https://wiki.ligo.org/DetChar/JanFeb2022DetCharF2F|LIGO Detchar F2F Meeting]]
    * DQ flags for O4
    * progress of DQR
  * Minutes
    * 120Hz glitches
      * No updates
    * DQ flags for O4
      * [[https://gwdoc.icrr.u-tokyo.ac.jp/cgi-bin/private/DocDB/ShowDocument?docid=13851|slide]]
      * (Yuzurihara) read BLRMS data and made the several plots with 1% and 99% percentile.
      * When KAGRA will be locked as observation mode?
       * hopefully after july, there will be lock trial for two monthes(?)
      * When you set the 1% criteria, always you throw away the 1% data?
       * We might need to consider the better procedure to care that point.
    * progress of DQR
      * [[https://klog.icrr.u-tokyo.ac.jp/osl/?r=19671|klog#19671]]

-----
=== 20220131 (Mon.) ===
  * Agenda
    * 120Hz glitches
    * Report from DQR hackathon
    * DQ flags for O4
    * Master thesis (Morisue-san)

-----
=== 20220117 (Mon.) ===
  * Agenda
    * 120Hz glitches
    * ITMX glitches
    * DQR progress
    * DQ flags for O4
  * Minutes
    * 120Hz glitches
      * No updates
      * Next step is coincidence search with signals around ETMY including local control sensors.
    * ITMX glitches
      * [[https://klog.icrr.u-tokyo.ac.jp/osl/?r=19212|klog#19212]]
      * K1:VIS-ITMX_F3_LVDTINF_GAS_{IN1,OUT} have glitches.
      * It seems to occur around AA chassis. (AA and cable replacement didn't help to improve situation).
      * We will try to find glitches on other channels on the same ADC board.
      * This channel should be added to Omicron search on SummaryPages.
    * DQR progress
      * [[https://gwdoc.icrr.u-tokyo.ac.jp/cgi-bin/private/DocDB/ShowDocument?docid=13721|JGW-G2213721]]
    * DQ flags for O4
      * No updates
    * O3GK paper
      * Threshold used for computing a glitch rate was changed as SNR=6.5.
      * It's a same criterion with LIGO, and Virgo.
      * Both GEO and KAGRA's results are now computed and draft was also updated.		    * Budget request
     * New computers for replacing too old servers (k1det0, 1): 500k-yen x2
     * HDD for new systems: 10k-yen x10-20
   * Progress reports
     * Upgrade DetChar computers (YamaT)
       * Testing DetChar softwares can be started after the update of CDS workstations is completed.
       * Test of CDS workstation needs more time (hopefully by end of April)
     * DQR update (Yuzurihara)
       * No update
     * Update contents of summary page (Oshino)
       * No update
     * Related to segment files (Uchikata, Narikawa)
       * No update
     * provide the dedicated summary page for O4a of KAGRA (Uchikata and Narikawa)
       * [[https://www.icrr.u-tokyo.ac.jp/~uchikata/Detchar/O4aSumm/gps/1368975618-1371337218/range/]]
       * SummaryPages process was executed on Kashiwa System-B.
       * Results were copied to the personal region of ICRR's Web server.
       * Finally this page will be opened only for LVK folks(?) on gwdet.
     * pyCBC trigger list for O4a data (Narikawa and Uchikata)
       * No update

-----
=== 20240306 (Wed.) ===
 * Agenda
   * Announcement
    * KAGRA international workshop (KIW11)@Taiwan: 2023/04/16-17 [[https://indico.phys.sinica.edu.tw/event/92/|web]]
    * Gravitaional wave open data workshop (GWODW7)@Taiwan: 2023/04/18-20 [[https://indico.phys.sinica.edu.tw/event/92/page/220-gravitational-wave-open-data-workshop|web]], [[https://gwosc.org/odw/odw2024/|Info. from GWOSC]]
    * O4a/preO4b(not call it as postO4a)/ER16/O4b schedule:
     * '''ER16''': It will nominally start at 1500 UTC (2400 JST) on '''20 Mar 2024''', and last for 2 weeks.
     * '''O4b''': We plan to commence O4b at 1500 UTC (2400 JST) on '''3 April 2024'''.
     * Ref.[[https://wiki.ligo.org/Operations/Agenda231214#Agenda|internal short announcements (reminders)]], [[https://observing.docs.ligo.org/plan/|public announcements]]
    * LVK meeting on March 11-14 at Louisiana State University [[https://www.lsu.edu/physics/lvkmeeting/|web]]
     * There is no fee for online participants
    * Update of member list for DetChar mailing list
    * KAGRA site report
   * Task list for the authorship 2024
   * Progress reports
    * O4a summary page(Uchikata)
     * After several attempts, the job was finished without errors. Another small problems,

-----
=== 20240228 (Wed.) ===
 * Agenda
   * Announcement
    * KAGRA international workshop (KIW11)@Taiwan: 2023/04/16-17 [[https://indico.phys.sinica.edu.tw/event/92/|web]]
    * Gravitaional wave open data workshop (GWODW7)@Taiwan: 2023/04/18-20 [[https://indico.phys.sinica.edu.tw/event/92/page/220-gravitational-wave-open-data-workshop|web]], [[https://gwosc.org/odw/odw2024/|Info. from GWOSC]]
    * O4a/preO4b(not call it as postO4a)/ER16/O4b schedule:
     * '''ER16''': It will nominally start at 1500 UTC (2400 JST) on '''20 Mar 2024''', and last for 2 weeks.
     * '''O4b''': We plan to commence O4b at 1500 UTC (2400 JST) on '''3 April 2024'''.
     * Ref.[[https://wiki.ligo.org/Operations/Agenda231214#Agenda|internal short announcements (reminders)]], [[https://observing.docs.ligo.org/plan/|public announcements]]
    * LVK meeting on March 11-14 at Louisiana State University [[https://www.lsu.edu/physics/lvkmeeting/|web]]
     * Early Registration is open until February 1
     * There is no fee for online participants
    * Update of member list for DetChar mailing list
    * KAGRA site report
   * Task list for the authorship 2024
   * Progress reports

 * Minutes
   * Task list for the authorship 2024 (not fixed yet)
   {{{
1. Commissioning support : serving data monitoring tools for site commissioners.
  This task focuses on the support of the IFO lock trial and/or noise hunting based on the request from the interferometer commissioners.
  Support of analyses to measured data (e.g. noise projection to the DARM with measured noise and TFs) is also contained in this task.
  Specialized tasks for each subgroup should be applied for in the respective group task.

2. Production and validation of Online Data Quality State Vector (for O4b/O5 preparation.
  This task focusing on providing the online DetChar products such as the online DQSV and managing various reliable online flags.
  Developing real-time and guardian codes for providing such flags should be contained in this task.

3. Production and validation of Segment information for O4b/O5 preparation.
  This task focusing on providing low-latency/offline segments.
  Providing segment itself, evaluation of efficient channels to make segments, evaluating benefit of segments on GW searches
  and cooperation with CIT staffs to update segment contents on DQSEGDB are contained in this task.

4. Construction of DQR (Data Quality Report) and igwn-alert framework for O4b/O5 RRT activities.
  This task focusing on providing contents from KAGRA to DQR web pages which is merged with LIGO, Virgo and KAGRA.

5. Support of Data Analysis group to set Data Category criteria for O4b/O5 joint observing run.
  This task focusing on the support of the GW-search activities based on the each WG of DAC.
  Providing data category for the pipelines of each GW sources, providing veto segments
  and other noise information such as identified spectral lines are also contained in this task.

6. Managing DET computers and their environments.
  This task contains the computer environment construction for providing the DetChar products in the cadence of online/low-latency/offline.
  Managing dedicated servers for sharing DetChar products among LVK is also contained in this task.

=====
- Noise hunting in KAGRA commissioning.
    Obsolescent
    Noise *hunting* without IFO (hardware) experts is unrealistic.
    In this meaning, the most of noise *hunting* can be covered in "Commissioning support”.
    If the tasks are related to the noise *finding* for the purpose of providing veto segment,
    they can be covered in “Support of Data Analysis”.
   }}}
     * hveto analysis is contained in 1. in the case that there is some communication with onsite commissioners via klog etc.
       * It's also potentially contained in 5. in the case of providing veto-ed segments, correlated channels etc.
     * Providing Run SummaryPage is contained in 5.
       * Exact sentence as "Making Run Summary" should be added the description in 5.
        
   * Progress reports
     * Unify conda environment in Kamioka detchar computers, k1sum[01] and k1det[012] (YamaT)
       * start consideration about the system upgrade to new Debian system.
       * DET tools depend on the CDS tools and CDS tools are well managed on apt-repository.
       * Only a part of CDS tools can be available on Anaconda now.
     * DQR update (Yuzurihara)
     * Update contents of summary page (Oshino)
     * Combine DET computer resources into one DET cluster at Kamioka site
     * Related to segment files (Uchikata, Narikawa)
     * provide the dedicated summary page for O4a of KAGRA (Uchikata and Narikawa) [[https://ldas-jobs.ligo.caltech.edu/~detchar/summary/O4a/|O4a (LV)]]

     * pyCBC trigger list for O4a data (Narikawa and Uchikata) [[https://ldas-jobs.ligo-wa.caltech.edu/~detchar/summary/day/20240108/detchar/pycbc_live_medium/| O4a (H1)]]
       * 4000s data analysis is ongoing.
         * Processed time is a few hours
       * Used template is changed from BBH to BNS.
         * Trigger behavior is changed by used templates.
       * Generated triggers are in the text format.
         * If LIGO's XML (LW XML?) is available, it may be very easy to make various plots on SummaryPages.

-----
=== 20240221 (Wed.) ===
 * Agenda
   * Announcement
      * KAGRA international workshop (KIW11)@Taiwan: 2023/04/16-17 [[https://indico.phys.sinica.edu.tw/event/92/|web]]
    * Gravitaional wave open data workshop (GWODW7)@Taiwan: 2023/04/18-20 [[https://indico.phys.sinica.edu.tw/event/92/page/220-gravitational-wave-open-data-workshop|web]]
    * O4a/preO4b(not call it as postO4a)/ER16/O4b schedule:
     * '''ER16''': It will nominally start at 1500 UTC (2400 JST) on '''20 Mar 2024''', and last for 2 weeks.
     * '''O4b''': We plan to commence O4b at 1500 UTC (2400 JST) on '''3 April 2024'''.
     * Ref.[[https://wiki.ligo.org/Operations/Agenda231214#Agenda|internal short announcements (reminders)]], [[https://observing.docs.ligo.org/plan/|public announcements]]
    * LVK meeting on March 11-14 at Louisiana State University [[https://www.lsu.edu/physics/lvkmeeting/|web]]
     * Early Registration is open until February 1
     * There is no fee for online participants
    * Update of member list for DetChar mailing list
    * KAGRA site report (Yuzurihara)
   * Commissioning support + tasks related to O4a
    * O4a for KAGRA : 2023/05/25 0:00 JST (=2023/05/24 15:00UTC) ~ 2023/06/21 8:00 JST
    * Event validation (YamaT)
    * Online data quality state vector (YamaT)
    * Tool to evaluate Gaussianity (Yamamura)
    * Scattered light noise (Yamamura)
     * [[https://klog.icrr.u-tokyo.ac.jp/osl/?r=28584|Investigation of scattered light noise in O4a]] [[https://dac.icrr.u-tokyo.ac.jp/KAGRA/DAWG/Detchar/klog/klog28584|plots]]
    * Pastavi update (Yuzurihara)
    * Noise hunting by machine learning and Hveto (Kyujin, Kihyun, Syifa)
    * Classification of glitch noise (Shikano, Oshino)
    * IPC glitch
    * line noise study (Samurai)
   * Unify conda environment in Kamioka detchar computers, k1sum[01] and k1det[012] (YamaT)
   * DQR update (Yuzurihara)
   * Update contents of summary page (Oshino)
   * Combine DET computer resources into one DET cluster at Kamioka site
   * Related to segment files (Uchikata, Narikawa)
   * provide the dedicated summary page for O4a of KAGRA (Uchikata and Narikawa) [[https://ldas-jobs.ligo.caltech.edu/~detchar/summary/O4a/|O4a (LV)]]
   * pyCBC trigger list for O4a data (Narikawa)
 * Minutes

-----
=== 20240214 (Wed.) ===
 * Agenda
   * Announcement
      * KAGRA international workshop (KIW11)@Taiwan: 2023/04/16-17 [[https://indico.phys.sinica.edu.tw/event/92/|web]]
    * Gravitaional wave open data workshop (GWODW7)@Taiwan: 2023/04/18-20 [[https://indico.phys.sinica.edu.tw/event/92/page/220-gravitational-wave-open-data-workshop|web]]
    * O4a/preO4b(not call it as postO4a)/ER16/O4b schedule:
     * '''ER16''': It will nominally start on '''13 Mar 2024''', and last for 2 weeks. (Note that ER16 will begin in the middle of the next LVK meeting at LSU, 11-14 March.)
     * '''O4b''': We plan to commence O4b at 1600 UTC (2500 JST) on '''27 Mar 2024'''.
     * Ref.[[https://wiki.ligo.org/Operations/Agenda231214#Agenda|internal short announcements (reminders)]], [[https://observing.docs.ligo.org/plan/|public announcements]]
    * White paper and task list for 2024 [[https://git.ligo.org/operations/operations-white-paper-2023|git repo]]
    * LVK meeting on March 11-14 at Louisiana State University [[https://www.lsu.edu/physics/lvkmeeting/|web]]
     * Early Registration is open until February 1
     * There is no fee for online participants
    * Update of member list for DetChar mailing list
    * KAGRA site report (Yuzurihara)
   * Commissioning support + tasks related to O4a
    * O4a for KAGRA : 2023/05/25 0:00 JST (=2023/05/24 15:00UTC) ~ 2023/06/21 8:00 JST
    * Event validation (YamaT)
    * Online data quality state vector (YamaT)
     * [[https://klog.icrr.u-tokyo.ac.jp/osl/?r=28555|Sanity check of DAC saturation bit provided by a new model]]
    * Tool to evaluate Gaussianity (Yamamura)
     * [[https://klog.icrr.u-tokyo.ac.jp/osl/?r=28568|Investigation of scattered light noise in O4a]]
    * Scattered light noise (Yamamura)
    * Pastavi update (Yuzurihara)
    * Noise hunting by machine learning and Hveto (Kyujin, Kihyun, Syifa)
    * Classification of glitch noise (Shikano, Oshino)
    * IPC glitch
    * line noise study (Samurai)
   * Unify conda environment in Kamioka detchar computers, k1sum[01] and k1det[012] (YamaT)
   * DQR update (Yuzurihara)
   * Update contents of summary page (Oshino)
   * Combine DET computer resources into one DET cluster at Kamioka site
   * Related to segment files (Uchikata, Narikawa)
   * provide the dedicated summary page for O4a of KAGRA (Uchikata and Narikawa) [[https://ldas-jobs.ligo.caltech.edu/~detchar/summary/O4a/|O4a (LV)]]
    * [[https://klog.icrr.u-tokyo.ac.jp/osl/?r=28538|O4a summary page]]
   * pyCBC trigger list for O4a data (Narikawa)
 * Minutes
    * Online data quality state vector (YamaT)
     * [[https://klog.icrr.u-tokyo.ac.jp/osl/?r=28555|Sanity check of DAC saturation bit provided by a new model]]
     * We need same test for ETMY model.
    * Scattered light noise (Yamamura)
     * [[https://klog.icrr.u-tokyo.ac.jp/osl/?r=28568|Investigation of scattered light noise in O4a]]
     * (oshino) why the double bounce occurred?
     * (yamaT) it's better to check both the feedback and error signal (OUT_DQ and IN1_DQ).
     * (oshino) PD signal might be helpful in the investigation. In POP_FORWARD, the scattered light was seen in the past.
    * Noise hunting by machine learning and Hveto (Kyujin, Kihyun, Syifa)
     * [[https://gwdoc.icrr.u-tokyo.ac.jp/cgi-bin/private/DocDB/ShowDocument?docid=15527|KAGRA O4a hveto results (0524 ~ 0606)]] [[https://gwdoc.icrr.u-tokyo.ac.jp/cgi-bin/private/DocDB/ShowDocument?docid=15632|KAGRA O4a hveto results (0607 ~ 0619)]]
     * hveto shows the many triggers on the time the scattered light noise appeared
     * (yamaT) IPC glitch was taken care in this analysis? It's better to use SCIENCE segment + IPC glitch segment.
     * It is interesting to compare the glitch rate and the analysis result with and without IPC glitch segments.
     * Yuzurihara shared that segment with Kihyun.
   * provide the dedicated summary page for O4a of KAGRA (Uchikata and Narikawa) [[https://ldas-jobs.ligo.caltech.edu/~detchar/summary/O4a/|O4a (LV)]]
    * [[https://klog.icrr.u-tokyo.ac.jp/osl/?r=28538|O4a summary page]]
   * pyCBC trigger list for O4a data (Narikawa)
    * (yamaT) can we include the trigger information by pycbc, in the summary page?

-----
=== 20240207 (Wed.) ===
 * Agenda
   * Announcement
      * KAGRA international workshop (KIW11)@Taiwan: 2023/04/16-17 [[https://indico.phys.sinica.edu.tw/event/92/|web]]
    * Gravitaional wave open data workshop (GWODW7)@Taiwan: 2023/04/18-20 [[https://indico.phys.sinica.edu.tw/event/92/page/220-gravitational-wave-open-data-workshop|web]]
    * O4a/preO4b(not call it as postO4a)/ER16/O4b schedule:
     * '''ER16''': It will nominally start on '''13 Mar 2024''', and last for 2 weeks. (Note that ER16 will begin in the middle of the next LVK meeting at LSU, 11-14 March.)
     * '''O4b''': We plan to commence O4b at 1600 UTC (2500 JST) on '''27 Mar 2024'''.
     * Ref.[[https://wiki.ligo.org/Operations/Agenda231214#Agenda|internal short announcements (reminders)]], [[https://observing.docs.ligo.org/plan/|public announcements]]
    * White paper and task list for 2024 [[https://git.ligo.org/operations/operations-white-paper-2023|git repo]]
    * LVK meeting on March 11-14 at Louisiana State University [[https://www.lsu.edu/physics/lvkmeeting/|web]]
     * Early Registration is open until February 1
     * There is no fee for online participants
    * Update of member list for DetChar mailing list
    * KAGRA site report (Yuzurihara)
   * Commissioning support + tasks related to O4a
    * O4a for KAGRA : 2023/05/25 0:00 JST (=2023/05/24 15:00UTC) ~ 2023/06/21 8:00 JST
    * Event validation (YamaT)
    * Online data quality state vector (YamaT)
    * Tool to evaluate Gaussianity (Yamamura)
    * Scattered light noise (Yamamura)
    * Pastavi update (Yuzurihara)
    * Noise hunting by machine learning and Hveto (Kyujin, Kihyun, Syifa)
    * Classification of glitch noise (Shikano, Oshino)
    * IPC glitch
    * line noise study (Samurai)
   * Unify conda environment in Kamioka detchar computers, k1sum[01] and k1det[012] (YamaT)
   * DQR update (Yuzurihara)
   * Update contents of summary page (Oshino)
   * Combine DET computer resources into one DET cluster at Kamioka site
   * Related to segment files (Uchikata, Narikawa)
   * Provide the dedicated summary page for O4a of KAGRA (Uchikata) [[https://ldas-jobs.ligo.caltech.edu/~detchar/summary/O4a/|O4a (LV)]]
 * Minutes
   * Online data quality state vector (YamaT)
    * [[https://klog.icrr.u-tokyo.ac.jp/osl/?r=28498|model update of k1detdq0]] This is bug fix of production of online data quality state vector related to DAC saturation.
    * The hardware test will be done this week an next week.
   * Tool to evaluate Gaussianity (Yamamura)
    * [[https://klog.icrr.u-tokyo.ac.jp/osl/?r=28519|Relaunch of GauCh]]
    * The codes were uploaded at [[https://git.ligo.org/yamamura/gauch|git repo]]. The preparation of brief documentation is ongoing.
   * Classification of glitch noise (Shikano, Oshino)
    * They restarted this project. The report will be done soon.
   * Provide the dedicated summary page for O4a of KAGRA (Uchikata) [[https://ldas-jobs.ligo.caltech.edu/~detchar/summary/O4a/|O4a (LV)]]
    * They tested the conda environment and configuration files for the production of the summary page. Except for the specific short time, they can generated the O4a summary page including duty cycle and inspiral range.
   * Generation of trigger list by pycbc (Narikawa)
    * Code test is ongoing by using the short 4096s data of O4a. The timeseries of chi square looks strange. They plan to apply the high pass filter, instead of window function.
    * (yamat) How do you decide clustering length?
    * (Narikawa) By software injection, we can evaluate how the SNR spreads and determine the clustering length.

-----
=== 20240131 (Wed.) ===
 * Agenda
   * Announcement
      * KAGRA international workshop (KIW11)@Taiwan: 2023/04/16-17 [[https://indico.phys.sinica.edu.tw/event/92/|web]]
    * Gravitaional wave open data workshop (GWODW7)@Taiwan: 2023/04/18-20 [[https://indico.phys.sinica.edu.tw/event/92/page/220-gravitational-wave-open-data-workshop|web]]
    * O4a/preO4b(not call it as postO4a)/ER16/O4b schedule:
     * '''ER16''': It will nominally start on '''13 Mar 2024''', and last for 2 weeks. (Note that ER16 will begin in the middle of the next LVK meeting at LSU, 11-14 March.)
     * '''O4b''': We plan to commence O4b at 1600 UTC (2500 JST) on '''27 Mar 2024'''.
     * Ref.[[https://wiki.ligo.org/Operations/Agenda231214#Agenda|internal short announcements (reminders)]], [[https://observing.docs.ligo.org/plan/|public announcements]]
    * White paper and task list for 2024 [[https://git.ligo.org/operations/operations-white-paper-2023|git repo]]
    * LVK meeting on March 11-14 at Louisiana State University [[https://www.lsu.edu/physics/lvkmeeting/|web]]
     * Early Registration is open until February 1
     * There is no fee for online participants
    * Update of member list for DetChar mailing list
    * LVK MoA survey summary [[https://dcc.ligo.org/G2400189|LIGO DCC]]
    * KAGRA site report (Yuzurihara)
   * Commissioning support + tasks related to O4a
    * O4a for KAGRA : 2023/05/25 0:00 JST (=2023/05/24 15:00UTC) ~ 2023/06/21 8:00 JST
    * Event validation (YamaT)
    * Tool to evaluate Gaussianity (Yamamura)
    * Scattered light noise (Yamamura)
    * Pastavi update (Yuzurihara)
    * Noise hunting by machine learning and Hveto (Kyujin, Kihyun, Syifa)
    * Classification of glitch noise (Shikano, Oshino)
    * IPC glitch
    * line noise study (Samurai)
   * Unify conda environment in Kamioka detchar computers, k1sum[01] and k1det[012] (YamaT)
   * DQR update (Yuzurihara)
   * Update contents of summary page (Oshino)
   * Combine DET computer resources into one DET cluster at Kamioka site
   * Related to segment files (Uchikata, Narikawa)
   * provide the dedicated summary page for O4a of KAGRA (Uchikata and Narikawa) [[https://ldas-jobs.ligo.caltech.edu/~detchar/summary/O4a/|O4a (LV)]]
 * Minutes
   * Noise hunting by machine learning and Hveto (Kyujin, Kihyun, Syifa)
    * [[https://klog.icrr.u-tokyo.ac.jp/osl/?r=28392|O4a hveto results]]
   * line noise study (Samurai)
    * [[https://gwdoc.icrr.u-tokyo.ac.jp/cgi-bin/private/DocDB/ShowDocument?docid=15613|slide]]
    * Is it possible to set the initial parameter in advance, such as prominence and height?
    * In future, it is better to extend the fft length to be longer for fine frequency resolution.
   * Update contents of summary page (Oshino)
    * [[https://klog.icrr.u-tokyo.ac.jp/osl/?r=28397|Update configuration file on SummaryPage]]
   * Related to segment files (Uchikata, Narikawa)
    * [[https://klog.icrr.u-tokyo.ac.jp/osl/?r=28399|Glitch rate for O4a]]
   * provide the dedicated summary page for O4a of KAGRA (Uchikata and Narikawa) [[https://ldas-jobs.ligo.caltech.edu/~detchar/summary/O4a/|O4a (LV)]]
    * The attempt to generate summary page is on system-B. For reading data, NDS2 server is helpful.

-----
=== 20240124 (Wed.) ===
 * Agenda
   * Announcement
      * KAGRA international workshop (KIW11)@Taiwan: 2023/04/16-17
    * Gravitaional wave open data workshop (GWODW7)@Taiwan: 2023/04/18-20 [[https://gwosc.org/workshops/|web]]
    * LIGO-Virgo-KAGRA detchar joint meeting
     * tileslot: onthly, 23:00 JST (14:00 UTC) or 6:00 JST (21 UTC)
     * Last meeting on Nov. 15 23:00 JST (14:00 UTC) [[https://wiki.ligo.org/DetChar/Telecon20231115|wiki]]
    * O4a/preO4b(not call it as postO4a)/ER16/O4b schedule:
     * '''O4a''': It will end at 1600 UTC on '''16 Jan 2024'''. LLO will end O4a observing early, at 1400 UTC.
     * '''ER16''': It will nominally start on '''13 Mar 2024''', and last for 2 weeks. (Note that ER16 will begin in the middle of the next LVK meeting at LSU, 11-14 March.)
     * '''O4b''': We plan to commence O4b at 1600 UTC (2500 JST) on '''27 Mar 2024'''.
     * Ref.[[https://wiki.ligo.org/Operations/Agenda231214#Agenda|internal short announcements (reminders)]], [[https://observing.docs.ligo.org/plan/|public announcements]]
    * Information of O4a [[https://dac.icrr.u-tokyo.ac.jp/KAGRA/Observations/O4a|wiki]] page
    * White paper and task list for 2024 [[https://git.ligo.org/operations/operations-white-paper-2023|git repo]]
    * LVK meeting on March 11-14 at Louisiana State University
    * Update of member list for DetChar mailing list
    * KAGRA site report (Yuzurihara)
   * Commissioning support + tasks related to O4a
    * O4a for KAGRA : 2023/05/25 0:00 JST (=2023/05/24 15:00UTC) ~ 2023/06/21 8:00 JST
    * Event validation (YamaT)
    * Tool to evaluate Gaussianity (Yamamura)
    * Scattered light noise (Yamamura)
    * Pastavi update (Yuzurihara)
    * Noise hunting by machine learning and Hveto (Kyujin, Kihyun, Syifa)
    * Classification of glitch noise (Shikano, Oshino)
    * IPC glitch
    * line noise study (Samurai)
     * Peak identifications [[https://gwdet.icrr.u-tokyo.ac.jp/~controls/misc/html/knownlines_o4a.html|web]]
   * Unify conda environment in Kamioka detchar computers, k1sum[01] and k1det[012] (YamaT)
   * DQR update (Yuzurihara)
   * Update contents of summary page (Oshino)
    * run Omicron at Kamioka site and refresh the Omicron plots on summary page during O4a period
   * Combine DET computer resources into one DET cluster at Kamioka site
   * Script to generate segment files (Uchikata, Narikawa)
   * Related to segment files (Uchikata, Narikawa)
   * provide the dedicated summary page for O4a of KAGRA? [[https://ldas-jobs.ligo.caltech.edu/~detchar/summary/O3a/|O3a (LV)]]
 * Minutes
    * Noise hunting by machine learning and Hveto (Kyujin, Kihyun, Syifa)
     * [[https://klog.icrr.u-tokyo.ac.jp/osl/?r=28392|O4a hveto results]]
    * Update contents of summary page (Oshino)
     * [[https://klog.icrr.u-tokyo.ac.jp/osl/?r=28390|Modified configuration file on SummaryPage]]

-----
=== 20240117 (Wed.) ===
 * Agenda
   * Announcement
      * KAGRA international workshop (KIW11)@Taiwan: 2023/04/16-17
    * Gravitaional wave open data workshop (GWODW7)@Taiwan: 2023/04/18-20 [[https://gwosc.org/workshops/|web]]
    * LIGO-Virgo-KAGRA detchar joint meeting
     * tileslot: onthly, 23:00 JST (14:00 UTC) or 6:00 JST (21 UTC)
     * Last meeting on Nov. 15 23:00 JST (14:00 UTC) [[https://wiki.ligo.org/DetChar/Telecon20231115|wiki]]
    * O4a/preO4b(not call it as postO4a)/ER16/O4b schedule:
     * '''O4a''': It will end at 1600 UTC on '''16 Jan 2024'''. LLO will end O4a observing early, at 1400 UTC.
     * '''ER16''': It will nominally start on '''13 Mar 2024''', and last for 2 weeks. (Note that ER16 will begin in the middle of the next LVK meeting at LSU, 11-14 March.)
     * '''O4b''': We plan to commence O4b at 1600 UTC (2500 JST) on '''27 Mar 2024'''.
     * Ref.[[https://wiki.ligo.org/Operations/Agenda231214#Agenda|internal short announcements (reminders)]], [[https://observing.docs.ligo.org/plan/|public announcements]]
    * Information of O4a [[https://dac.icrr.u-tokyo.ac.jp/KAGRA/Observations/O4a|wiki]] page
    * White paper and task list for 2024 [[https://git.ligo.org/operations/operations-white-paper-2023|git repo]]
    * LVK meeting on March 11-14 at Louisiana State University
    * KAGRA site report (Yuzurihara)
   * Commissioning support + tasks related to O4a
    * O4a for KAGRA : 2023/05/25 0:00 JST (=2023/05/24 15:00UTC) ~ 2023/06/21 8:00 JST
    * Event validation (YamaT)
    * Tool to evaluate Gaussianity (Yamamura)
    * Scattered light noise (Yamamura)
    * Pastavi update (Yuzurihara)
    * Noise hunting by machine learning and Hveto (Kyujin, Kihyun, Syifa)
    * Classification of glitch noise (Shikano, Oshino)
    * IPC glitch
    * line noise study (Samurai)
     * Peak identifications [[https://gwdet.icrr.u-tokyo.ac.jp/~controls/misc/html/knownlines_o4a.html|web]]
   * Unify conda environment in Kamioka detchar computers, k1sum[01] and k1det[012] (YamaT)
   * DQR update (Yuzurihara)
   * Update contents of summary page (Oshino)
    * run Omicron at Kamioka site and refresh the Omicron plots on summary page during O4a period
   * Combine DET computer resources into one DET cluster at Kamioka site
   * Script to generate segment files (Uchikata, Narikawa)
   * Related to segment files (Uchikata, Narikawa)
   * provide the dedicated summary page for O4a of KAGRA? [[https://ldas-jobs.ligo.caltech.edu/~detchar/summary/O3a/|O3a (LV)]]
 * Minutes
   * Tool to evaluate Gaussianity (Yamamura)
    * Gauch recently looks not running. There is no html page linked from summary page. We will check the details later.
   * DQR update (Yuzurihara)
    * I asked the remote help to Derek. I'm submitteing the application for the ICRR computer account.
   * IPC glitch
    * [[https://klog.icrr.u-tokyo.ac.jp/osl/?r=28025|Summary of recent segment for IPC glitch (2023/11~12)]]
   * Noise hunting by machine learning and Hveto (Kyujin, Kihyun, Syifa)
    * [[https://klog.icrr.u-tokyo.ac.jp/osl/?r=28194|2023-05-24 ~ 06-07 O4a hveto results]]
    * The analysis for the remained date will be
   * Update contents of summary page (Oshino)
    * [[https://klog.icrr.u-tokyo.ac.jp/osl/?r=28057|Modified configuration files of SummaryPage]]
    * [[https://klog.icrr.u-tokyo.ac.jp/osl/?r=28247|Modified configuration file on SummaryPage]]
Line 330: Line 457:
  * [[KAGRA/Subgroups/DET/Meeting/2023|2023]]
  * [[KAGRA/Subgroups/DET/Meeting/2022|2022]]

Meetings

  • Meeting time: 11:00-11:30 JST/KST on every Wednesday
  • Meeting room: Zoom3

Contents

  1. Meetings
    1. Agenda & Minutes
      1. 20240403 (Wed.)
      2. 20240326 (Wed.)
      3. 20240306 (Wed.)
      4. 20240228 (Wed.)
      5. 20240221 (Wed.)
      6. 20240214 (Wed.)
      7. 20240207 (Wed.)
      8. 20240131 (Wed.)
      9. 20240124 (Wed.)
      10. 20240117 (Wed.)
      11. Past meeting

Agenda & Minutes

20240403 (Wed.)

  • Agenda
    • Announcement

      • KAGRA international workshop (KIW11)@Taiwan: 2023/04/16-17 web

      • Gravitaional wave open data workshop (GWODW7)@Taiwan: 2023/04/18-20 web, Info. from GWOSC

      • O4a/preO4b(not call it as postO4a)/ER16/O4b schedule:

        • ER16: It will nominally start at 1500 UTC (2400 JST) on 20 Mar 2024, and last for 2 weeks.

        • O4b: We plan to commence O4b at 1500 UTC (2400 JST) on 3 April 2024.

        • Ref.internal discussion, public announcements

      • Update of DQSEGDB server help ticket

      • KAGRA site report
    • Budget request
    • Progress reports

      • Upgrade DetChar computers (YamaT)

      • DQR update (Yuzurihara)
      • Update contents of summary page (Oshino)
      • Related to segment files (Uchikata, Narikawa)
      • provide the dedicated summary page for O4a of KAGRA (Uchikata and Narikawa)
      • pyCBC trigger list for O4a data (Narikawa and Uchikata)

20240326 (Wed.)

  • Agenda
    • Announcement

      • KAGRA international workshop (KIW11)@Taiwan: 2023/04/16-17 web

      • Gravitaional wave open data workshop (GWODW7)@Taiwan: 2023/04/18-20 web, Info. from GWOSC

      • O4a/preO4b(not call it as postO4a)/ER16/O4b schedule:

        • ER16: It will nominally start at 1500 UTC (2400 JST) on 20 Mar 2024, and last for 2 weeks.

        • O4b: We plan to commence O4b at 1500 UTC (2400 JST) on 3 April 2024.

        • Ref.internal discussion, public announcements

      • KAGRA site report
    • Budget request
    • Progress reports

      • Upgrade DetChar computers (YamaT)

      • DQR update (Yuzurihara)
      • Update contents of summary page (Oshino)
      • Related to segment files (Uchikata, Narikawa)
      • provide the dedicated summary page for O4a of KAGRA (Uchikata and Narikawa)
      • pyCBC trigger list for O4a data (Narikawa and Uchikata)
  • Minutes
    • Budget request
      • New computers for replacing too old servers (k1det0, 1): 500k-yen x2
      • HDD for new systems: 10k-yen x10-20
    • Progress reports

      • Upgrade DetChar computers (YamaT)

        • Testing DetChar softwares can be started after the update of CDS workstations is completed.

        • Test of CDS workstation needs more time (hopefully by end of April)
      • DQR update (Yuzurihara)
        • No update
      • Update contents of summary page (Oshino)
        • No update
      • Related to segment files (Uchikata, Narikawa)
        • No update
      • provide the dedicated summary page for O4a of KAGRA (Uchikata and Narikawa)
      • pyCBC trigger list for O4a data (Narikawa and Uchikata)
        • No update

20240306 (Wed.)

  • Agenda
    • Announcement

      • KAGRA international workshop (KIW11)@Taiwan: 2023/04/16-17 web

      • Gravitaional wave open data workshop (GWODW7)@Taiwan: 2023/04/18-20 web, Info. from GWOSC

      • O4a/preO4b(not call it as postO4a)/ER16/O4b schedule:

      • LVK meeting on March 11-14 at Louisiana State University web

        • There is no fee for online participants

      • Update of member list for DetChar mailing list

      • KAGRA site report
    • Task list for the authorship 2024
    • Progress reports
      • O4a summary page(Uchikata)
        • After several attempts, the job was finished without errors. Another small problems,

20240228 (Wed.)

  • Agenda
    • Announcement

      • KAGRA international workshop (KIW11)@Taiwan: 2023/04/16-17 web

      • Gravitaional wave open data workshop (GWODW7)@Taiwan: 2023/04/18-20 web, Info. from GWOSC

      • O4a/preO4b(not call it as postO4a)/ER16/O4b schedule:

      • LVK meeting on March 11-14 at Louisiana State University web

        • Early Registration is open until February 1
        • There is no fee for online participants

      • Update of member list for DetChar mailing list

      • KAGRA site report
    • Task list for the authorship 2024
    • Progress reports
  • Minutes
    • Task list for the authorship 2024 (not fixed yet) 
      1. Commissioning support : serving data monitoring tools for site commissioners.
  This task focuses on the support of the IFO lock trial and/or noise hunting based on the request from the interferometer commissioners.
  Support of analyses to measured data (e.g. noise projection to the DARM with measured noise and TFs) is also contained in this task.
  Specialized tasks for each subgroup should be applied for in the respective group task.

2. Production and validation of Online Data Quality State Vector (for O4b/O5 preparation.
  This task focusing on providing the online DetChar products such as the online DQSV and managing various reliable online flags.
  Developing real-time and guardian codes for providing such flags should be contained in this task.

3. Production and validation of Segment information for O4b/O5 preparation.
  This task focusing on providing low-latency/offline segments.
  Providing segment itself, evaluation of efficient channels to make segments, evaluating benefit of segments on GW searches
  and cooperation with CIT staffs to update segment contents on DQSEGDB are contained in this task.

4. Construction of DQR (Data Quality Report) and igwn-alert framework for O4b/O5 RRT activities.
  This task focusing on providing contents from KAGRA to DQR web pages which is merged with LIGO, Virgo and KAGRA.

5. Support of Data Analysis group to set Data Category criteria for O4b/O5 joint observing run.
  This task focusing on the support of the GW-search activities based on the each WG of DAC.
  Providing data category for the pipelines of each GW sources, providing veto segments 
  and other noise information such as identified spectral lines are also contained in this task.

6. Managing DET computers and their environments.
  This task contains the computer environment construction for providing the DetChar products in the cadence of online/low-latency/offline.
  Managing dedicated servers for sharing DetChar products among LVK is also contained in this task.

=====
- Noise hunting in KAGRA commissioning.
    Obsolescent 
    Noise *hunting* without IFO (hardware) experts is unrealistic.
    In this meaning, the most of noise *hunting* can be covered in "Commissioning support”.
    If the tasks are related to the noise *finding* for the purpose of providing veto segment,
    they can be covered in “Support of Data Analysis”.
      • hveto analysis is contained in 1. in the case that there is some communication with onsite commissioners via klog etc.
        • It's also potentially contained in 5. in the case of providing veto-ed segments, correlated channels etc.

      • Providing Run SummaryPage is contained in 5.

        • Exact sentence as "Making Run Summary" should be added the description in 5.
    • Progress reports
      • Unify conda environment in Kamioka detchar computers, k1sum[01] and k1det[012] (YamaT)
        • start consideration about the system upgrade to new Debian system.
        • DET tools depend on the CDS tools and CDS tools are well managed on apt-repository.
        • Only a part of CDS tools can be available on Anaconda now.
      • DQR update (Yuzurihara)
      • Update contents of summary page (Oshino)
      • Combine DET computer resources into one DET cluster at Kamioka site
      • Related to segment files (Uchikata, Narikawa)

      • provide the dedicated summary page for O4a of KAGRA (Uchikata and Narikawa) O4a (LV)

      • pyCBC trigger list for O4a data (Narikawa and Uchikata) O4a (H1)

        • 4000s data analysis is ongoing.
          • Processed time is a few hours
        • Used template is changed from BBH to BNS.
          • Trigger behavior is changed by used templates.
        • Generated triggers are in the text format.

          • If LIGO's XML (LW XML?) is available, it may be very easy to make various plots on SummaryPages.

20240221 (Wed.)

  • Agenda
    • Announcement

      • KAGRA international workshop (KIW11)@Taiwan: 2023/04/16-17 web

      • Gravitaional wave open data workshop (GWODW7)@Taiwan: 2023/04/18-20 web

      • O4a/preO4b(not call it as postO4a)/ER16/O4b schedule:

      • LVK meeting on March 11-14 at Louisiana State University web

        • Early Registration is open until February 1
        • There is no fee for online participants

      • Update of member list for DetChar mailing list

      • KAGRA site report (Yuzurihara)
    • Commissioning support + tasks related to O4a
      • O4a for KAGRA : 2023/05/25 0:00 JST (=2023/05/24 15:00UTC) ~ 2023/06/21 8:00 JST
      • Event validation (YamaT)
      • Online data quality state vector (YamaT)
      • Tool to evaluate Gaussianity (Yamamura)
      • Scattered light noise (Yamamura)
      • Pastavi update (Yuzurihara)
      • Noise hunting by machine learning and Hveto (Kyujin, Kihyun, Syifa)
      • Classification of glitch noise (Shikano, Oshino)
      • IPC glitch
      • line noise study (Samurai)
    • Unify conda environment in Kamioka detchar computers, k1sum[01] and k1det[012] (YamaT)
    • DQR update (Yuzurihara)
    • Update contents of summary page (Oshino)
    • Combine DET computer resources into one DET cluster at Kamioka site
    • Related to segment files (Uchikata, Narikawa)

    • provide the dedicated summary page for O4a of KAGRA (Uchikata and Narikawa) O4a (LV)

    • pyCBC trigger list for O4a data (Narikawa)
  • Minutes

20240214 (Wed.)

  • Agenda
    • Announcement

      • KAGRA international workshop (KIW11)@Taiwan: 2023/04/16-17 web

      • Gravitaional wave open data workshop (GWODW7)@Taiwan: 2023/04/18-20 web

      • O4a/preO4b(not call it as postO4a)/ER16/O4b schedule:

      • White paper and task list for 2024 git repo

      • LVK meeting on March 11-14 at Louisiana State University web

        • Early Registration is open until February 1
        • There is no fee for online participants

      • Update of member list for DetChar mailing list

      • KAGRA site report (Yuzurihara)
    • Commissioning support + tasks related to O4a
    • Unify conda environment in Kamioka detchar computers, k1sum[01] and k1det[012] (YamaT)
    • DQR update (Yuzurihara)
    • Update contents of summary page (Oshino)
    • Combine DET computer resources into one DET cluster at Kamioka site
    • Related to segment files (Uchikata, Narikawa)

    • provide the dedicated summary page for O4a of KAGRA (Uchikata and Narikawa) O4a (LV)

    • pyCBC trigger list for O4a data (Narikawa)
  • Minutes
    • Online data quality state vector (YamaT)
    • Scattered light noise (Yamamura)

      • Investigation of scattered light noise in O4a

      • (oshino) why the double bounce occurred?
      • (yamaT) it's better to check both the feedback and error signal (OUT_DQ and IN1_DQ).
      • (oshino) PD signal might be helpful in the investigation. In POP_FORWARD, the scattered light was seen in the past.
    • Noise hunting by machine learning and Hveto (Kyujin, Kihyun, Syifa)

      • KAGRA O4a hveto results (0524 ~ 0606) KAGRA O4a hveto results (0607 ~ 0619)

      • hveto shows the many triggers on the time the scattered light noise appeared
      • (yamaT) IPC glitch was taken care in this analysis? It's better to use SCIENCE segment + IPC glitch segment.
      • It is interesting to compare the glitch rate and the analysis result with and without IPC glitch segments.
      • Yuzurihara shared that segment with Kihyun.

    • provide the dedicated summary page for O4a of KAGRA (Uchikata and Narikawa) O4a (LV)

    • pyCBC trigger list for O4a data (Narikawa)
      • (yamaT) can we include the trigger information by pycbc, in the summary page?

20240207 (Wed.)

  • Agenda
    • Announcement

      • KAGRA international workshop (KIW11)@Taiwan: 2023/04/16-17 web

      • Gravitaional wave open data workshop (GWODW7)@Taiwan: 2023/04/18-20 web

      • O4a/preO4b(not call it as postO4a)/ER16/O4b schedule:

      • White paper and task list for 2024 git repo

      • LVK meeting on March 11-14 at Louisiana State University web

        • Early Registration is open until February 1
        • There is no fee for online participants

      • Update of member list for DetChar mailing list

      • KAGRA site report (Yuzurihara)
    • Commissioning support + tasks related to O4a
      • O4a for KAGRA : 2023/05/25 0:00 JST (=2023/05/24 15:00UTC) ~ 2023/06/21 8:00 JST
      • Event validation (YamaT)
      • Online data quality state vector (YamaT)
      • Tool to evaluate Gaussianity (Yamamura)
      • Scattered light noise (Yamamura)
      • Pastavi update (Yuzurihara)
      • Noise hunting by machine learning and Hveto (Kyujin, Kihyun, Syifa)
      • Classification of glitch noise (Shikano, Oshino)
      • IPC glitch
      • line noise study (Samurai)
    • Unify conda environment in Kamioka detchar computers, k1sum[01] and k1det[012] (YamaT)
    • DQR update (Yuzurihara)
    • Update contents of summary page (Oshino)
    • Combine DET computer resources into one DET cluster at Kamioka site
    • Related to segment files (Uchikata, Narikawa)

    • Provide the dedicated summary page for O4a of KAGRA (Uchikata) O4a (LV)

  • Minutes
    • Online data quality state vector (YamaT)

      • model update of k1detdq0 This is bug fix of production of online data quality state vector related to DAC saturation.

      • The hardware test will be done this week an next week.
    • Tool to evaluate Gaussianity (Yamamura)
    • Classification of glitch noise (Shikano, Oshino)
      • They restarted this project. The report will be done soon.

    • Provide the dedicated summary page for O4a of KAGRA (Uchikata) O4a (LV)

      • They tested the conda environment and configuration files for the production of the summary page. Except for the specific short time, they can generated the O4a summary page including duty cycle and inspiral range.
    • Generation of trigger list by pycbc (Narikawa)
      • Code test is ongoing by using the short 4096s data of O4a. The timeseries of chi square looks strange. They plan to apply the high pass filter, instead of window function.
      • (yamat) How do you decide clustering length?
      • (Narikawa) By software injection, we can evaluate how the SNR spreads and determine the clustering length.

20240131 (Wed.)

  • Agenda
    • Announcement

      • KAGRA international workshop (KIW11)@Taiwan: 2023/04/16-17 web

      • Gravitaional wave open data workshop (GWODW7)@Taiwan: 2023/04/18-20 web

      • O4a/preO4b(not call it as postO4a)/ER16/O4b schedule:

      • White paper and task list for 2024 git repo

      • LVK meeting on March 11-14 at Louisiana State University web

        • Early Registration is open until February 1
        • There is no fee for online participants

      • Update of member list for DetChar mailing list

      • LVK MoA survey summary LIGO DCC

      • KAGRA site report (Yuzurihara)
    • Commissioning support + tasks related to O4a
      • O4a for KAGRA : 2023/05/25 0:00 JST (=2023/05/24 15:00UTC) ~ 2023/06/21 8:00 JST
      • Event validation (YamaT)
      • Tool to evaluate Gaussianity (Yamamura)
      • Scattered light noise (Yamamura)
      • Pastavi update (Yuzurihara)
      • Noise hunting by machine learning and Hveto (Kyujin, Kihyun, Syifa)
      • Classification of glitch noise (Shikano, Oshino)
      • IPC glitch
      • line noise study (Samurai)
    • Unify conda environment in Kamioka detchar computers, k1sum[01] and k1det[012] (YamaT)
    • DQR update (Yuzurihara)
    • Update contents of summary page (Oshino)
    • Combine DET computer resources into one DET cluster at Kamioka site
    • Related to segment files (Uchikata, Narikawa)

    • provide the dedicated summary page for O4a of KAGRA (Uchikata and Narikawa) O4a (LV)

  • Minutes
    • Noise hunting by machine learning and Hveto (Kyujin, Kihyun, Syifa)
    • line noise study (Samurai)

      • slide

      • Is it possible to set the initial parameter in advance, such as prominence and height?
      • In future, it is better to extend the fft length to be longer for fine frequency resolution.
    • Update contents of summary page (Oshino)
    • Related to segment files (Uchikata, Narikawa)

    • provide the dedicated summary page for O4a of KAGRA (Uchikata and Narikawa) O4a (LV)

      • The attempt to generate summary page is on system-B. For reading data, NDS2 server is helpful.

20240124 (Wed.)

  • Agenda
    • Announcement
      • KAGRA international workshop (KIW11)@Taiwan: 2023/04/16-17

      • Gravitaional wave open data workshop (GWODW7)@Taiwan: 2023/04/18-20 web

      • LIGO-Virgo-KAGRA detchar joint meeting
        • tileslot: onthly, 23:00 JST (14:00 UTC) or 6:00 JST (21 UTC)

        • Last meeting on Nov. 15 23:00 JST (14:00 UTC) wiki

      • O4a/preO4b(not call it as postO4a)/ER16/O4b schedule:

        • O4a: It will end at 1600 UTC on 16 Jan 2024. LLO will end O4a observing early, at 1400 UTC.

        • ER16: It will nominally start on 13 Mar 2024, and last for 2 weeks. (Note that ER16 will begin in the middle of the next LVK meeting at LSU, 11-14 March.)

        • O4b: We plan to commence O4b at 1600 UTC (2500 JST) on 27 Mar 2024.

        • Ref.internal short announcements (reminders), public announcements

      • Information of O4a wiki page

      • White paper and task list for 2024 git repo

      • LVK meeting on March 11-14 at Louisiana State University

      • Update of member list for DetChar mailing list

      • KAGRA site report (Yuzurihara)
    • Commissioning support + tasks related to O4a
      • O4a for KAGRA : 2023/05/25 0:00 JST (=2023/05/24 15:00UTC) ~ 2023/06/21 8:00 JST
      • Event validation (YamaT)
      • Tool to evaluate Gaussianity (Yamamura)
      • Scattered light noise (Yamamura)
      • Pastavi update (Yuzurihara)
      • Noise hunting by machine learning and Hveto (Kyujin, Kihyun, Syifa)
      • Classification of glitch noise (Shikano, Oshino)
      • IPC glitch
      • line noise study (Samurai)

        • Peak identifications web

    • Unify conda environment in Kamioka detchar computers, k1sum[01] and k1det[012] (YamaT)
    • DQR update (Yuzurihara)
    • Update contents of summary page (Oshino)
      • run Omicron at Kamioka site and refresh the Omicron plots on summary page during O4a period
    • Combine DET computer resources into one DET cluster at Kamioka site
    • Script to generate segment files (Uchikata, Narikawa)
    • Related to segment files (Uchikata, Narikawa)

    • provide the dedicated summary page for O4a of KAGRA? O3a (LV)

  • Minutes

20240117 (Wed.)

  • Agenda
    • Announcement
      • KAGRA international workshop (KIW11)@Taiwan: 2023/04/16-17

      • Gravitaional wave open data workshop (GWODW7)@Taiwan: 2023/04/18-20 web

      • LIGO-Virgo-KAGRA detchar joint meeting
        • tileslot: onthly, 23:00 JST (14:00 UTC) or 6:00 JST (21 UTC)

        • Last meeting on Nov. 15 23:00 JST (14:00 UTC) wiki

      • O4a/preO4b(not call it as postO4a)/ER16/O4b schedule:

        • O4a: It will end at 1600 UTC on 16 Jan 2024. LLO will end O4a observing early, at 1400 UTC.

        • ER16: It will nominally start on 13 Mar 2024, and last for 2 weeks. (Note that ER16 will begin in the middle of the next LVK meeting at LSU, 11-14 March.)

        • O4b: We plan to commence O4b at 1600 UTC (2500 JST) on 27 Mar 2024.

        • Ref.internal short announcements (reminders), public announcements

      • Information of O4a wiki page

      • White paper and task list for 2024 git repo

      • LVK meeting on March 11-14 at Louisiana State University
      • KAGRA site report (Yuzurihara)
    • Commissioning support + tasks related to O4a
      • O4a for KAGRA : 2023/05/25 0:00 JST (=2023/05/24 15:00UTC) ~ 2023/06/21 8:00 JST
      • Event validation (YamaT)
      • Tool to evaluate Gaussianity (Yamamura)
      • Scattered light noise (Yamamura)
      • Pastavi update (Yuzurihara)
      • Noise hunting by machine learning and Hveto (Kyujin, Kihyun, Syifa)
      • Classification of glitch noise (Shikano, Oshino)
      • IPC glitch
      • line noise study (Samurai)

        • Peak identifications web

    • Unify conda environment in Kamioka detchar computers, k1sum[01] and k1det[012] (YamaT)
    • DQR update (Yuzurihara)
    • Update contents of summary page (Oshino)
      • run Omicron at Kamioka site and refresh the Omicron plots on summary page during O4a period
    • Combine DET computer resources into one DET cluster at Kamioka site
    • Script to generate segment files (Uchikata, Narikawa)
    • Related to segment files (Uchikata, Narikawa)

    • provide the dedicated summary page for O4a of KAGRA? O3a (LV)

  • Minutes

Past meeting

KAGRA/Subgroups/DET/Meeting (last edited 2024-12-25 11:08:07 by HirotakaYuzurihara)