Differences between revisions 1 and 26 (spanning 25 versions)
⇤ ← Revision 1 as of 2021-02-25 17:41:55 →
Size: 390
Editor: chihiro.kozakai
Comment:
← Revision 26 as of 2022-11-16 15:45:21 → ⇥
Size: 5349
Editor: TatsuyaNarikawa
Comment:
Deletions are marked like this. Additions are marked like this.
Line 6: Line 6:
Describe the pages in this category... == Reference ==
 * [[https://hveto.readthedocs.io/en/stable/index.html|online document]]
 * [[https://github.com/gwdetchar/hveto|Source code (GitHub)]]
 * [[https://iopscience.iop.org/article/10.1088/0264-9381/28/23/235005|Paper]]
 * [[https://github.com/gw-detchar/tools|KAGRA scripts (GitHub)]]
Line 8: Line 12:
To add a page to this category, add a link to this page on the last line of the page. You can add multiple categories to a page. = Environment setting =
Line 10: Line 14:
'''List of pages in this category:''' --(If you need to install from scratch, [[https://computing.docs.ligo.org/conda/]] will be helpful.)--
Error happens with igwn-py38. ligo-summary-3.7 is OK.
Line 12: Line 17:
<<FullSearchCached(category:KAGRA/Subgroups/DET/Hveto)>> == In Kashiwa, m31 ==
Line 14: Line 19:
----
CategoryCategory		  * Environment
{{{
> source /gpfs/sw/conda/etc/profile.d/conda.sh
> conda activate igwn-py39-20220707
}}}

(Warning!: Hveto does not work properly for the latest one, `igwn-py39-202201102`.
Below, `igwn-py39-202200707` was used.)


 * Create segment lists (ongoing)

  * Scripts are here `/home/detchar/git/kagra-detchar/tools/Segments/Script/` or [[https://github.com/gw-detchar/tools/tree/master/Segments/Script|Scripts (GitHub)]].

  * Run, for example, `> python make15minSegment.py -m -d 2022-11-09`
 
  * Outputs are xml and txt files stored under `/home/detchar/Segments/`.

  * See `K1-GRD_LOCKED` for the locked segments.


 * Run Omicron
  * Scripts are here `/home/detchar/git/kagra-detchar/tools/Omicron/Script/`or [[https://github.com/gw-detchar/tools/tree/master/Omicron/Script|GitHub]].

  * Cache files are here `/home/detchar/cache/Cache_GPS/`. Use the Virgo format, `ffl`.

  * `manual_segment_kashiwa.sh`

  * `mvtoK1.sh`

  * The output trigger files should be stored in `/home/detchar/triggers/K1`.

 * Run Hveto
  * Scripts are here `/home/detchar/git/kagra-detchar/tools/Hveto/Script/`or [[https://github.com/gw-detchar/tools/tree/master/Hveto/Script|GitHub]].

  * `hveto_O3GK_arg.sh`

  * Need a segment list file in the xml format.

  * Hveto reads the Omicron triggers file from `/home/detchar/triggers/K1` as a default. Failed to use cache file options for m31 (see [[https://klog.icrr.u-tokyo.ac.jp/osl/?r=22870|klog22870]].


== In Kamioka, k1det0 ==


--(> source /cvmfs/oasis.opensciencegrid.org/ligo/sw/conda/etc/profile.d/conda.sh)--
--(> conda activate igwn-py38)--

{{{
> conda activate ligo-summary-3.7
}}}

= Manual script =

Script for kashiwa server

[[https://github.com/gw-detchar/tools/blob/master/Hveto/Script/hveto_O3GK_arg.sh]]

== Usage ==
{{{
> ./hveto_O3GK_arg.sh 2020-04-10 > log.dat 2>&1
}}}

== Important parameters ==

 * SEGMENTFILE : Now it is setting for O3GK. Maybe you need to modify for O4 or later, for example
{{{
SEGMENTFILE=/home/detchar/Segments/K1-SCIENCE_MODE/2022/K1-SCIENCE_MODE_UTC_${DIRNAME_DATE}.xml
}}}

 * INIFILE : For O3GK, [[https://github.com/gw-detchar/tools/blob/master/Hveto/etc/O3GKC20.ini|O3GKC20.ini]] is used. Detail will be written later again.

 * OUTPUTDIR : Please set it as you like. When it is under /mnt/hveto/ or /home/controls/public_html/hveto/ (linked to /mnt/hveto/), the result is available on web browser, https://gwdet.icrr.u-tokyo.ac.jp/~controls/hveto/ .

 * NPROCESS : Originally it was 10 but modified to 1. It is because sometimes multiple process cause error.

= ini file =

 * The latest file dedicated for O3GK is [[https://github.com/gw-detchar/tools/blob/master/Hveto/etc/O3GKC20.ini|O3GKC20.ini]]. This is based on the ini file used in LIGO, [[https://git.ligo.org/detchar/ligo-monitors/-/blob/master/configurations/hveto/h1l1-hveto-daily-post-o3.ini|h1l1-hveto-daily-post-o3.ini]] with some modification for KAGRA.

== Important parameters ==
 * For the detail of ini file contents, see [[https://hveto.readthedocs.io/en/stable/api/hveto.config.html|Configuration files for Hveto]]
 * [segment]
   * analysis-flag : You may need to modify it for the online process. The name of the segment list has to be set.
   * padding : Please coordinate with the analysis group whether it covers the necessary range.
 * [primary]
  * channel : K1:DAC-STRAIN_C20 is offline data. For online, {{{channel = %(IFO)s:CAL-CS_PROC_DARM_DISPLACEMENT_DQ}}} or {{{channel = %(IFO)s:CAL-CS_PROC_C00_STRAIN_DBL_DQ}}} will do.
  * snr-threshold : It maybe better to optimize.
  * frequency-range : Please coordinate with the analysis group whether it covers the necessary range.
 * [auxiliary]
  * frequency-range : Please coordinate with the analysis group whether it covers the necessary range.
  * channels : Now the channel list is exactly specified here. Before O4, it should be reconsidered. For example, ASC channels may need to be added.
 * [safety]
  * unsafe-channels : Actually this is not necessary if [auxiliary] channels is set, just written to clarify that they must not be used in hveto. Here is the reference of the discussion for O3GK [[https://gwdoc.icrr.u-tokyo.ac.jp/cgi-bin/private/DocDB/ShowDocument?docid=11874|slides]].

= Note for developer =
 * Maybe it is buggy in the counting of coincidence events ?
 * Not automated in Kashiwa server.
 * Please check the link of /home/detchar/triggers/K1. The data under this link is used. Usually, it should be linked to /mnt/triggers/K1/, but for O3GK /mnt/triggers/K1_20200415/K1_20200415/K1/ was used.
 * It will be good if parameter optimization is done with ER data or something.

Reference

Environment setting

If you need to install from scratch, https://computing.docs.ligo.org/conda/ will be helpful. Error happens with igwn-py38. ligo-summary-3.7 is OK.

In Kashiwa, m31

  • Environment 

> source /gpfs/sw/conda/etc/profile.d/conda.sh
> conda activate igwn-py39-20220707

(Warning!: Hveto does not work properly for the latest one, igwn-py39-202201102. Below, igwn-py39-202200707 was used.)

  • Create segment lists (ongoing)

    • Scripts are here /home/detchar/git/kagra-detchar/tools/Segments/Script/ or Scripts (GitHub).

    • Run, for example, > python make15minSegment.py -m -d 2022-11-09

    • Outputs are xml and txt files stored under /home/detchar/Segments/.

    • See K1-GRD_LOCKED for the locked segments.

  • Run Omicron

    • Scripts are here /home/detchar/git/kagra-detchar/tools/Omicron/Script/or GitHub.

    • Cache files are here /home/detchar/cache/Cache_GPS/. Use the Virgo format, ffl.

    • manual_segment_kashiwa.sh

    • mvtoK1.sh

    • The output trigger files should be stored in /home/detchar/triggers/K1.

  • Run Hveto

    • Scripts are here /home/detchar/git/kagra-detchar/tools/Hveto/Script/or GitHub.

    • hveto_O3GK_arg.sh

    • Need a segment list file in the xml format.

    • Hveto reads the Omicron triggers file from /home/detchar/triggers/K1 as a default. Failed to use cache file options for m31 (see klog22870.

In Kamioka, k1det0

> source /cvmfs/oasis.opensciencegrid.org/ligo/sw/conda/etc/profile.d/conda.sh > conda activate igwn-py38 

> conda activate ligo-summary-3.7

Manual script

Script for kashiwa server

https://github.com/gw-detchar/tools/blob/master/Hveto/Script/hveto_O3GK_arg.sh

Usage

> ./hveto_O3GK_arg.sh 2020-04-10 > log.dat 2>&1

Important parameters

  • SEGMENTFILE : Now it is setting for O3GK. Maybe you need to modify for O4 or later, for example 

SEGMENTFILE=/home/detchar/Segments/K1-SCIENCE_MODE/2022/K1-SCIENCE_MODE_UTC_${DIRNAME_DATE}.xml

  • INIFILE : For O3GK, O3GKC20.ini is used. Detail will be written later again.

  • OUTPUTDIR : Please set it as you like. When it is under /mnt/hveto/ or /home/controls/public_html/hveto/ (linked to /mnt/hveto/), the result is available on web browser, https://gwdet.icrr.u-tokyo.ac.jp/~controls/hveto/ .

  • NPROCESS : Originally it was 10 but modified to 1. It is because sometimes multiple process cause error.

ini file

Important parameters

  • For the detail of ini file contents, see Configuration files for Hveto

  • [segment]
    • analysis-flag : You may need to modify it for the online process. The name of the segment list has to be set.
    • padding : Please coordinate with the analysis group whether it covers the necessary range.
  • [primary]

    • channel : K1:DAC-STRAIN_C20 is offline data. For online, channel = %(IFO)s:CAL-CS_PROC_DARM_DISPLACEMENT_DQ or channel = %(IFO)s:CAL-CS_PROC_C00_STRAIN_DBL_DQ will do.

    • snr-threshold : It maybe better to optimize.
    • frequency-range : Please coordinate with the analysis group whether it covers the necessary range.
  • [auxiliary]
    • frequency-range : Please coordinate with the analysis group whether it covers the necessary range.
    • channels : Now the channel list is exactly specified here. Before O4, it should be reconsidered. For example, ASC channels may need to be added.
  • [safety]

    • unsafe-channels : Actually this is not necessary if [auxiliary] channels is set, just written to clarify that they must not be used in hveto. Here is the reference of the discussion for O3GK slides.

Note for developer

  • Maybe it is buggy in the counting of coincidence events ?
  • Not automated in Kashiwa server.
  • Please check the link of /home/detchar/triggers/K1. The data under this link is used. Usually, it should be linked to /mnt/triggers/K1/, but for O3GK /mnt/triggers/K1_20200415/K1_20200415/K1/ was used.
  • It will be good if parameter optimization is done with ER data or something.

KAGRA/Subgroups/DET/Hveto (last edited 2023-02-14 14:28:05 by nami.uchikata)