Differences between revisions 4 and 5
⇤ ← Revision 4 as of 2025-07-22 15:08:31 →
Size: 2801
Editor: HirotakaYuzurihara
Comment:
← Revision 5 as of 2025-07-22 15:35:40 → ⇥
Size: 2326
Editor: HirotakaYuzurihara
Comment:
Deletions are marked like this. Additions are marked like this.
Line 15: Line 15:
--- not yet ---
Line 22: Line 24:


 * install ligo-proxy-init, from [[https://computing.docs.ligo.org/guide/software/ldg-client/|the LDG Client package]]

   {{{
wget http://www.lsc-group.phys.uwm.edu/lscdatagrid/doc/ldg-client.sh -O /tmp/ldg-client.sh && sudo bash /tmp/ldg-client.sh
   }}}

  * To test the certification,

  {{{
gracedb ping
  }}}
  {{{
grid-proxy-info
  }}}

  * The usage of {{{ecp-get-cert}}}
  {{{
ecp-get-cert --identity-provider KAGRA --username albert.einstein --verbose
   }}}

Installation

  • (2025/07/22) Yuzurihara prepared the virtual environment o4_dqr_1 on k1detms0.

  • DQR tasks are supported by python 3.11

  • This procedure will require the authentication of git.ligo.org.

  • To read KAGRA data by using NDS, We need to edit gwpy code (see instruction) 

    • mamba create --name o4_dqr_1 python=3.10.11 -y
mamba activate o4_dqr_1
mamba install gwpy==3.0.4 numpy==1.24.3 scipy==1.10.1 -y
mamba install m2crypto ciecplib python-nds2-client cryptography -y
mamba install igwn-alert==0.7 -y
mamba install tree markuppy -y

--- not yet ---

pip install git+https://git.ligo.org/o4-dqr/o4-dqr-configuration.git
pip install git+https://github.com/gwdetchar/gwdetchar.git
pip install git+https://git.ligo.org/detchar/dqrtasks.git

python -m pip install gwpy[astro]

Added RETRY option for DAG submission

  • Edit the code (o4-dqr-configuration/dqr_config/DQRdag.py) 

    •  #self.retry = 0
 # (2022/07/21 yuzu added)
 self.retry = 5

Generate DAG files

  • By following instruction, prepare ini files for DQR task manager.

    • This procedure will NOT require the access GraceDB, because the public alert will be used.

    • For test code, see /users/yuzu/work/DQR/Script/o4-dqr-configuration:k1det1 

      mkdir ~/public_html/event
dqr-create-dag -g S190924h -v -c ex_configs/defaults.ini ex_configs/condor.ini ex_configs/stationarity1.ini ex_configs/omega1.ini

  • The generated DAG files are located in /home/controls/public_html/events/

  • Because we don't store the O3 data in KAGRA site, we need to run this job with gps option. 
    • mkdir ~/public_html/event
dqr-create-dag -g 1318260000 -v -c ex_configs/defaults.ini ex_configs/condor.ini ex_configs/stationarity1.ini ex_configs/omega1.ini

Submit DAG jobs

  • For example on k1det1 
    cd /home/controls/public_html/events/
condor_submit_dag S190924h/data_quality_report_S190924h.dag

  • Result plots and html are ~/public_html/eventsS190924h/omegascan/plots/ and ~/public_html/eventsS190924h/omegascan/about/index.html

KAGRA/Subgroups/DET/DQR/environment_k1detms0 (last edited 2025-07-22 15:35:40 by HirotakaYuzurihara)