NoEMi
The Noise Frequency Event Miner (NoEMi) is a Virgo software tool dedicated to the monitoring and identification of spectral noise lines.
It uses codes for CW analysis to find and track spectral lines found in a given list of channels. It also looks for spectral features in coincidence between the "main channel" and the "auxiliary channels".
NoEMi documentation: https://apps.virgo-gw.eu/noemi/docs/index.html
This version, has 3 main components:
- the NoEMi events database (DB);
- the Line-Finder script (LF);
- the web user interface (WUI).
In addition to NoEMi the LinesDB will be installed soon.
Requirements
Main requirements:
HTCondor MySQL Python Apache HTTP server PHP
The following Python libraries can be installed with pip
pip install htcondor pip install pymysql pip install numpy
The PHP Data Objects module could be necessary.
MySQL has been installed from scratch, the admin user credentials are (this is the root user for any MySQL operation):
Username: root Password: user_admin_pass
Get NoEMi
The full NoEMi package is available in the Virgo SVN software repository
Note that, to access the repository, you will need to use your EGO Active Directory credentials. More information on obtaining these is available here.
- Download the full package
svn co https://svn.ego-gw.it/svn/advsw/Noemi/branches/v2/trunk \
NoEMi- The folder will contain the three components of NoEMi and the documentation
NoEMi/
/db --> MySQL Database
/doc --> Documentation
/noemi --> Line finder python scripts
/wui --> Web user interface
Host machines and Users
The 3 components of NoEMi: the DB, the Line finder and the WUI are installed on the following machines
DB host: localhost LF hosts: localhost WUI host: localhost --> web page work in progress
The following MySQL users have been created:
1. The web user interface (WUI) MySQL user
Username: noemi_wui Password: noemi_wui_pass
2. The Line-Finder (LF) MySQL user
Username: noemi_user Password: noemi_user_pass
Changes for KAGRA
The "K1" detector case has been added to the main SFDB (Short Fourier Transform DataBase) executable. The SFDBs are used also for CW analysis in Virgo.
The list of channels/sampling frequency of the channel used is:
K1:CAL-CS_PROC_C00_STRAIN_DBL_DQ 16384 K1:PEM-ACC_PSL_TABLE_PSL1_Z_OUT_DQ 2048 K1:PEM-ACC_PSL_TABLE_PSL2_Z_OUT_DQ 2048 K1:PEM-ACC_PSL_TABLE_PSL3_Z_OUT_DQ 2048 K1:PEM-MIC_PSL_TABLE_PSL4_Z_OUT_DQ 16384 K1:PEM-ACC_MCF_TABLE_REFL_Z_OUT_DQ 2048 K1:PEM-MIC_MCF_TABLE_REFL_Z_OUT_DQ 16384 K1:PEM-MIC_EXC_BOOTH_EXC_Z_OUT_DQ 2048 K1:PEM-MIC_EYC_BOOTH_EYC_Z_OUT_DQ 2048 K1:PEM-ACC_OMC_TABLE_AS_Z_OUT_DQ 2048 K1:PEM-MIC_OMC_TABLE_AS_Z_OUT_DQ 2048 K1:PEM-MIC_BS_TABLE_POP_Z_OUT_DQ 16384 K1:PEM-ACC_BS_TABLE_POP_Z_OUT_DQ 2048 K1:PEM-MAG_BS_BOOTH_BS_X_OUT_DQ 16384 K1:PEM-MAG_BS_BOOTH_BS_Y_OUT_DQ 16384 K1:PEM-MAG_BS_BOOTH_BS_Z_OUT_DQ 16384 K1:PEM-MAG_EXC_BOOTH_EXC_X_OUT_DQ 16384 K1:PEM-MAG_EXC_BOOTH_EXC_Y_OUT_DQ 16384 K1:PEM-MAG_EXC_BOOTH_EXC_Z_OUT_DQ 16384 K1:PEM-MAG_EYC_BOOTH_EYC_X_OUT_DQ 16384 K1:PEM-MAG_EYC_BOOTH_EYC_Y_OUT_DQ 16384 K1:PEM-MAG_EYC_BOOTH_EYC_Z_OUT_DQ 16384
Staus
- The NoEMi events database is installed
- The Line finder scripts are installed
- The WUI output pages are not pubicly visible (coordination with Gary Hemming ongoing)
- Communication between the LF scripts and Condor BQS is working
- Communication between the LF scripts and the NoEMi events MySQL DB is working
What's missing
- The main executable for the creation of SFDBs needs minor modification this is a C compilable code, test ongoing
- Automatic creation of ffl files (ffl is simply the list of .gwf frame files where in the first column you have the path to the .gwf file and as a second column the starting GPS time of the frame). A script already exist, needs to be adapted.