Differences between revisions 3 and 4
⇤ ← Revision 3 as of 2025-07-22 15:07:53 →
Size: 3147
Editor: HirotakaYuzurihara
Comment:
← Revision 4 as of 2025-07-22 15:08:31 → ⇥
Size: 2801
Editor: HirotakaYuzurihara
Comment:
Deletions are marked like this. Additions are marked like this.
Line 22: Line 22:

Line 27: Line 29:

 * X.509 certification
  * For the additional permission to access GraceDB, we need to ask LIGO+Virgo colleague.
  * There are [[https://computing.docs.ligo.org/guide/authentication/#kagra|two options]] for KAGRA account. Here Yuzurihara used ligo-proxy-init.

  {{{
ligo-proxy-init -i shibbi.pki.itc.u-tokyo.ac.jp albert.einstein
  }}}

Installation

  • (2025/07/22) Yuzurihara prepared the virtual environment o4_dqr_1 on k1detms0.

  • DQR tasks are supported by python 3.11

  • This procedure will require the authentication of git.ligo.org.

  • To read KAGRA data by using NDS, We need to edit gwpy code (see instruction) 

    • mamba create --name o4_dqr_1 python=3.10.11 -y
mamba activate o4_dqr_1
mamba install gwpy==3.0.4 numpy==1.24.3 scipy==1.10.1 -y
mamba install m2crypto ciecplib python-nds2-client cryptography -y
mamba install igwn-alert==0.7 -y
mamba install tree markuppy -y

pip install git+https://git.ligo.org/o4-dqr/o4-dqr-configuration.git
pip install git+https://github.com/gwdetchar/gwdetchar.git
pip install git+https://git.ligo.org/detchar/dqrtasks.git

python -m pip install gwpy[astro]

  • install ligo-proxy-init, from the LDG Client package 

    • wget http://www.lsc-group.phys.uwm.edu/lscdatagrid/doc/ldg-client.sh -O /tmp/ldg-client.sh && sudo bash /tmp/ldg-client.sh
    • To test the certification, 
      gracedb ping
      grid-proxy-info

    • The usage of ecp-get-cert 

      ecp-get-cert --identity-provider KAGRA --username albert.einstein --verbose

Added RETRY option for DAG submission

  • Edit the code (o4-dqr-configuration/dqr_config/DQRdag.py) 

    •  #self.retry = 0
 # (2022/07/21 yuzu added)
 self.retry = 5

Generate DAG files

  • By following instruction, prepare ini files for DQR task manager.

    • This procedure will NOT require the access GraceDB, because the public alert will be used.

    • For test code, see /users/yuzu/work/DQR/Script/o4-dqr-configuration:k1det1 

      mkdir ~/public_html/event
dqr-create-dag -g S190924h -v -c ex_configs/defaults.ini ex_configs/condor.ini ex_configs/stationarity1.ini ex_configs/omega1.ini

  • The generated DAG files are located in /home/controls/public_html/events/

  • Because we don't store the O3 data in KAGRA site, we need to run this job with gps option. 
    • mkdir ~/public_html/event
dqr-create-dag -g 1318260000 -v -c ex_configs/defaults.ini ex_configs/condor.ini ex_configs/stationarity1.ini ex_configs/omega1.ini

Submit DAG jobs

  • For example on k1det1 
    cd /home/controls/public_html/events/
condor_submit_dag S190924h/data_quality_report_S190924h.dag

  • Result plots and html are ~/public_html/eventsS190924h/omegascan/plots/ and ~/public_html/eventsS190924h/omegascan/about/index.html

KAGRA/Subgroups/DET/DQR/environment_k1detms0 (last edited 2025-07-22 15:35:40 by HirotakaYuzurihara)