Size: 944
Comment:
|
Size: 6697
Comment:
|
Deletions are marked like this. | Additions are marked like this. |
Line 6: | Line 6: |
= Reference = [[https://github.com/gwdetchar/hveto|Source code (GitHub)]] [[https://iopscience.iop.org/article/10.1088/0264-9381/28/23/235005|Paper]] |
== Reference == * [[https://hveto.readthedocs.io/en/stable/index.html|online document]] * [[https://github.com/gwdetchar/hveto|Source code (GitHub)]] * [[https://iopscience.iop.org/article/10.1088/0264-9381/28/23/235005|Paper]] * [[https://github.com/gw-detchar/tools|KAGRA scripts (GitHub)]] |
Line 12: | Line 14: |
If you need to install from scratch, [[https://computing.docs.ligo.org/conda/]] will be helpful. | --(If you need to install from scratch, [[https://computing.docs.ligo.org/conda/]] will be helpful.)-- Error happens with igwn-py38. ligo-summary-3.7 is OK. |
Line 16: | Line 19: |
* Environment | |
Line 17: | Line 21: |
> source /gpfs/ligo/sw/conda/etc/profile.d/conda.sh > conda activate igwn-py38 |
> source /gpfs/sw/conda/etc/profile.d/conda.sh > conda activate igwn-py39-20220707 |
Line 20: | Line 24: |
(Warning!: Hveto does not work properly for the latest one, `igwn-py39-202201102`. Below, `igwn-py39-202200707` was used.) * Create segment lists (ongoing) * Scripts are here `/home/detchar/git/kagra-detchar/tools/Segments/Script/` or [[https://github.com/gw-detchar/tools/tree/master/Segments/Script|Scripts (GitHub)]]. * Run, for example, {{{ > python make15minSegment.py -m -d 2022-11-09 }}} * Outputs are xml and txt files stored under `/home/detchar/Segments/`. * See `K1-GRD_LOCKED` for the locked segments. * Run Omicron * Scripts are here `/home/detchar/git/kagra-detchar/tools/Omicron/Script/`or [[https://github.com/gw-detchar/tools/tree/master/Omicron/Script|GitHub]]. * Cache files are here `/home/detchar/cache/Cache_GPS/`. Use the Virgo format, `ffl`. * Run, for example, {{{ > manual_segment_kashiwa.sh omicron_parameters.txt omicron_segments.txt > log.txt 2>&1 }}} See `log.txt`. * By using the `GWpy` function or the useful python script, `OpenEventTable.py`, you can see the summary of triggers. Copy `/home/chihiro.kozakai/detchar/analysis/code/gwpy/Kozapy/samples/mylib` into the directory you are working in. And run `> python OpenEventTable.py` after edited the python script. {{{ peak_time peak_time_ns start_time start_time_ns duration peak_frequency central_freq bandwidth channel amplitude snr ---------- ------------ ---------- ------------- -------- -------------- ------------ --------- ------------------------------ ----------- -------- 1351988200 3906011 1351988200 0 0.25 35.59674 39.68511 52.27211 CAL-CS_PROC_DARM_STRAIN_DBL_DQ 2.38791e-18 12.789 1351988225 85937023 1351988225 62500000 0.03125 219.68658 219.70084 5.00196 CAL-CS_PROC_DARM_STRAIN_DBL_DQ 3.10313e-18 6.13658 1351988248 960937023 1351988248 937500000 0.03125 118.76051 118.79103 5.38494 CAL-CS_PROC_DARM_STRAIN_DBL_DQ 1.93323e-18 6.20764 1351988259 996093034 1351988259 250000000 0.75 35.59674 44.91249 67.09149 CAL-CS_PROC_DARM_STRAIN_DBL_DQ 3.97061e-18 21.26549 }}} * `mvtoK1.sh` * The output trigger files should be stored in `/home/detchar/triggers/K1`. * Run Hveto * Scripts are here `/home/detchar/git/kagra-detchar/tools/Hveto/Script/`or [[https://github.com/gw-detchar/tools/tree/master/Hveto/Script|GitHub]]. * `hveto_O3GK_arg.sh` * Need a segment list file in the xml format. * Hveto reads the Omicron triggers file from `/home/detchar/triggers/K1` as a default. Failed to use cache file options for m31 (see [[https://klog.icrr.u-tokyo.ac.jp/osl/?r=22870|klog22870]]. |
|
Line 23: | Line 81: |
--(> source /cvmfs/oasis.opensciencegrid.org/ligo/sw/conda/etc/profile.d/conda.sh)-- --(> conda activate igwn-py38)-- |
|
Line 24: | Line 86: |
> source /cvmfs/oasis.opensciencegrid.org/ligo/sw/conda/etc/profile.d/conda.sh > conda activate igwn-py38 |
> conda activate ligo-summary-3.7 |
Line 28: | Line 89: |
#Describe the pages in this category... | = Manual script = |
Line 30: | Line 91: |
#To add a page to this category, add a link to this page on the last line of the page. You can add multiple categories to a page. | Script for kashiwa server |
Line 32: | Line 93: |
#'''List of pages in this category:''' | [[https://github.com/gw-detchar/tools/blob/master/Hveto/Script/hveto_O3GK_arg.sh]] |
Line 34: | Line 95: |
#<<FullSearchCached(category:KAGRA/Subgroups/DET/Hveto)>> | == Usage == {{{ > ./hveto_O3GK_arg.sh 2020-04-10 > log.dat 2>&1 }}} |
Line 36: | Line 100: |
#---- #CategoryCategory |
== Important parameters == * SEGMENTFILE : Now it is setting for O3GK. Maybe you need to modify for O4 or later, for example {{{ SEGMENTFILE=/home/detchar/Segments/K1-SCIENCE_MODE/2022/K1-SCIENCE_MODE_UTC_${DIRNAME_DATE}.xml }}} * INIFILE : For O3GK, [[https://github.com/gw-detchar/tools/blob/master/Hveto/etc/O3GKC20.ini|O3GKC20.ini]] is used. Detail will be written later again. * OUTPUTDIR : Please set it as you like. When it is under /mnt/hveto/ or /home/controls/public_html/hveto/ (linked to /mnt/hveto/), the result is available on web browser, https://gwdet.icrr.u-tokyo.ac.jp/~controls/hveto/ . * NPROCESS : Originally it was 10 but modified to 1. It is because sometimes multiple process cause error. = ini file = * The latest file dedicated for O3GK is [[https://github.com/gw-detchar/tools/blob/master/Hveto/etc/O3GKC20.ini|O3GKC20.ini]]. This is based on the ini file used in LIGO, [[https://git.ligo.org/detchar/ligo-monitors/-/blob/master/configurations/hveto/h1l1-hveto-daily-post-o3.ini|h1l1-hveto-daily-post-o3.ini]] with some modification for KAGRA. == Important parameters == * For the detail of ini file contents, see [[https://hveto.readthedocs.io/en/stable/api/hveto.config.html|Configuration files for Hveto]] * [segment] * analysis-flag : You may need to modify it for the online process. The name of the segment list has to be set. * padding : Please coordinate with the analysis group whether it covers the necessary range. * [primary] * channel : K1:DAC-STRAIN_C20 is offline data. For online, {{{channel = %(IFO)s:CAL-CS_PROC_DARM_DISPLACEMENT_DQ}}} or {{{channel = %(IFO)s:CAL-CS_PROC_C00_STRAIN_DBL_DQ}}} will do. * snr-threshold : It maybe better to optimize. * frequency-range : Please coordinate with the analysis group whether it covers the necessary range. * [auxiliary] * frequency-range : Please coordinate with the analysis group whether it covers the necessary range. * channels : Now the channel list is exactly specified here. Before O4, it should be reconsidered. For example, ASC channels may need to be added. * [safety] * unsafe-channels : Actually this is not necessary if [auxiliary] channels is set, just written to clarify that they must not be used in hveto. Here is the reference of the discussion for O3GK [[https://gwdoc.icrr.u-tokyo.ac.jp/cgi-bin/private/DocDB/ShowDocument?docid=11874|slides]]. = Note for developer = * Maybe it is buggy in the counting of coincidence events ? * Not automated in Kashiwa server. * Please check the link of /home/detchar/triggers/K1. The data under this link is used. Usually, it should be linked to /mnt/triggers/K1/, but for O3GK /mnt/triggers/K1_20200415/K1_20200415/K1/ was used. * It will be good if parameter optimization is done with ER data or something. |
Reference
Environment setting
If you need to install from scratch, https://computing.docs.ligo.org/conda/ will be helpful. Error happens with igwn-py38. ligo-summary-3.7 is OK.
In Kashiwa, m31
- Environment
> source /gpfs/sw/conda/etc/profile.d/conda.sh > conda activate igwn-py39-20220707
(Warning!: Hveto does not work properly for the latest one, igwn-py39-202201102. Below, igwn-py39-202200707 was used.)
- Create segment lists (ongoing)
Scripts are here /home/detchar/git/kagra-detchar/tools/Segments/Script/ or Scripts (GitHub).
- Run, for example,
> python make15minSegment.py -m -d 2022-11-09
Outputs are xml and txt files stored under /home/detchar/Segments/.
See K1-GRD_LOCKED for the locked segments.
- Run Omicron
Scripts are here /home/detchar/git/kagra-detchar/tools/Omicron/Script/or GitHub.
Cache files are here /home/detchar/cache/Cache_GPS/. Use the Virgo format, ffl.
- Run, for example,
> manual_segment_kashiwa.sh omicron_parameters.txt omicron_segments.txt > log.txt 2>&1
See log.txt.
By using the GWpy function or the useful python script, OpenEventTable.py, you can see the summary of triggers. Copy /home/chihiro.kozakai/detchar/analysis/code/gwpy/Kozapy/samples/mylib into the directory you are working in. And run > python OpenEventTable.py after edited the python script.
peak_time peak_time_ns start_time start_time_ns duration peak_frequency central_freq bandwidth channel amplitude snr ---------- ------------ ---------- ------------- -------- -------------- ------------ --------- ------------------------------ ----------- -------- 1351988200 3906011 1351988200 0 0.25 35.59674 39.68511 52.27211 CAL-CS_PROC_DARM_STRAIN_DBL_DQ 2.38791e-18 12.789 1351988225 85937023 1351988225 62500000 0.03125 219.68658 219.70084 5.00196 CAL-CS_PROC_DARM_STRAIN_DBL_DQ 3.10313e-18 6.13658 1351988248 960937023 1351988248 937500000 0.03125 118.76051 118.79103 5.38494 CAL-CS_PROC_DARM_STRAIN_DBL_DQ 1.93323e-18 6.20764 1351988259 996093034 1351988259 250000000 0.75 35.59674 44.91249 67.09149 CAL-CS_PROC_DARM_STRAIN_DBL_DQ 3.97061e-18 21.26549
mvtoK1.sh
The output trigger files should be stored in /home/detchar/triggers/K1.
- Run Hveto
In Kamioka, k1det0
> source /cvmfs/oasis.opensciencegrid.org/ligo/sw/conda/etc/profile.d/conda.sh > conda activate igwn-py38
> conda activate ligo-summary-3.7
Manual script
Script for kashiwa server
https://github.com/gw-detchar/tools/blob/master/Hveto/Script/hveto_O3GK_arg.sh
Usage
> ./hveto_O3GK_arg.sh 2020-04-10 > log.dat 2>&1
Important parameters
- SEGMENTFILE : Now it is setting for O3GK. Maybe you need to modify for O4 or later, for example
SEGMENTFILE=/home/detchar/Segments/K1-SCIENCE_MODE/2022/K1-SCIENCE_MODE_UTC_${DIRNAME_DATE}.xml
INIFILE : For O3GK, O3GKC20.ini is used. Detail will be written later again.
OUTPUTDIR : Please set it as you like. When it is under /mnt/hveto/ or /home/controls/public_html/hveto/ (linked to /mnt/hveto/), the result is available on web browser, https://gwdet.icrr.u-tokyo.ac.jp/~controls/hveto/ .
- NPROCESS : Originally it was 10 but modified to 1. It is because sometimes multiple process cause error.
ini file
The latest file dedicated for O3GK is O3GKC20.ini. This is based on the ini file used in LIGO, h1l1-hveto-daily-post-o3.ini with some modification for KAGRA.
Important parameters
For the detail of ini file contents, see Configuration files for Hveto
- [segment]
- analysis-flag : You may need to modify it for the online process. The name of the segment list has to be set.
- padding : Please coordinate with the analysis group whether it covers the necessary range.
- [primary]
channel : K1:DAC-STRAIN_C20 is offline data. For online, channel = %(IFO)s:CAL-CS_PROC_DARM_DISPLACEMENT_DQ or channel = %(IFO)s:CAL-CS_PROC_C00_STRAIN_DBL_DQ will do.
- snr-threshold : It maybe better to optimize.
- frequency-range : Please coordinate with the analysis group whether it covers the necessary range.
- [auxiliary]
- frequency-range : Please coordinate with the analysis group whether it covers the necessary range.
- channels : Now the channel list is exactly specified here. Before O4, it should be reconsidered. For example, ASC channels may need to be added.
- [safety]
unsafe-channels : Actually this is not necessary if [auxiliary] channels is set, just written to clarify that they must not be used in hveto. Here is the reference of the discussion for O3GK slides.
Note for developer
- Maybe it is buggy in the counting of coincidence events ?
- Not automated in Kashiwa server.
- Please check the link of /home/detchar/triggers/K1. The data under this link is used. Usually, it should be linked to /mnt/triggers/K1/, but for O3GK /mnt/triggers/K1_20200415/K1_20200415/K1/ was used.
- It will be good if parameter optimization is done with ER data or something.