1
Running SPECFEM on
EUAsiaGrid
Yi-Tao HE
ASGC, Taiwan
DEMO Program
• Available from:
–
3
1. Data Preparation
– SPECFEM Executable
– Earth Model
OR
– SPECFEM Source Package
2. Make a Job Description (use JDL)
– Parameter File (Parfile)
– Source (CMTSOLUTION)
3. Job Submission
Steps to run SPECFEM on the Grid
4
gLite: Computing Flow
submit job
sandbox
large data
large data
sandbox
dispatch job
resource status
replication info
query data
location
find suitable
resources
Job Flow
Data Flow
INFO
1
2
0
3
job status
5
#CPU Free Total Jobs Running Waiting ComputingElement
24 5 0 0 0 grid010.ct.infn.it:2119/jobmanager-lcgpbs-euasia
48 18 0 0 0 iceage-ce-01.ct.infn.it:2119/jobmanager-lcgpbs-euasia
36 36 0 0 0 ce01.knowledgegrid.net.my:2119/jobmanager-lcgpbs-euasia
24 24 0 0 0 cladonia.geranium.um.edu.my:2119/jobmanager-pbs-euasia
48 48 0 0 0 khaldun.biruni.upm.my:8443/cream-pbs-euasia
72 62 2 2 0 haitham.biruni.upm.my:2119/jobmanager-pbs-euasia
224 223 0 0 0 razi.biruni.upm.my:2119/jobmanager-pbs-euasia
120 24 0 0 0 buhawi.pscigrid.gov.ph:2119/jobmanager-lcgpbs-euasia
48 48 0 0 0 liknayan.pscigrid.gov.ph:2119/jobmanager-lcgpbs-euasia
64 16 9 5 4 ce2.egee.cesnet.cz:2119/jobmanager-pbs-euasia
1377 1 1 0 1 w-ce01.grid.sinica.edu.tw:2119/jobmanager-lcgpbs-euasia
1377 1 1 0 1 lcg00125.grid.sinica.edu.tw:2119/jobmanager-lcgpbs-euasia
1377 1 1 0 1 cream01.grid.sinica.edu.tw:8443/cream-pbs-euasia
1208 1208 0 0 0 quanta.grid.sinica.edu.tw:2119/jobmanager-lcgpbs-euasia
2 2 0 0 0 ce.haii.or.th:2119/jobmanager-lcgpbs-euasia
4 4 4 0 4 lion.lsr.nectec.or.th:2119/jobmanager-lcgpbs-euasia
468 124 0 0 0 f-ce01.grid.sinica.edu.tw:2119/jobmanager-lcgpbs-euasia
2 1 0 0 0 ce.ioit.vngrid.vinaren.vn:2119/jobmanager-lcgpbs-euasia
4 4 0 0 0 ce.keylab.ioit-hcm.vngrid.org:2119/jobmanager-lcgpbs-euasia
EUAsiaGrid CEs
6
Avail Space(Kb) Used Space(Kb) Type SEs
294996322 98842511 n.a aliserv6.ct.infn.it
132348281 32067550 n.a se01.knowledgegrid.net.my
1027169651 55084356 n.a se02.knowledgegrid.net.my
545140244 29692829 n.a solorina.geranium.um.edu.my
933426537 50553879 n.a dpm.biruni.upm.my
2054356578 110159245 n.a se.pscigrid.gov.ph
2054356578 110159245 n.a se.pscigrid.gov.ph
-2077 1749660184 n.a dpm1.egee.cesnet.cz
2330000 56730000 n.a dpm01.grid.sinica.edu.tw
1028583163 55173749 n.a se.haii.or.th
1392783539 81311285 n.a rhino.lsr.nectec.or.th
691825328 41988537 n.a se.ifi.vngrid.vinaren.vn
690978299 42835566 n.a se.ioit.vngrid.vinaren.vn
64542890 3512133 n.a se.keylab.ioit-hcm.vngrid.org
EUAsiaGrid SEs
7
1. Data Preparation
– SPECFEM Executable
– Earth Model
OR
– SPECFEM Source Package
2. Make a Job Description (use JDL)
– Parameter File (Parfile)
– Source (CMTSOLUTION)
3. Job Submission
Steps to run SPECFEM on the Grid
8
Data Preparation
resource status
replication info
register data
find storage
elements
Data Flow
INFO
specfem3d_globe.src.tgz
9
Copy the SPECFEM package to SE
10
Data Preparation (replica)
LFN GUID
SURL1
SURL2
SURL3
xxxxxxxx-xxxx-xxxx-
xxxxxxxxxxxxx
/grid/euasia/earth/specfem3d_globe.tgz
dpm.biruni.upm.my
dpm01.grid.sinica.edu.tw
se.ifi.vngrid.vinaren.vn
11
1. Data Preparation
– SPECFEM Executable
– Earth Model
OR
– SPECFEM Source Package
2. Make a Job Description (use JDL)
– Parameter File (Parfile)
– Source (CMTSOLUTION)
3. Job Submission
Steps to run SPECFEM on the Grid
Description of a SPECFEM Job
• INPUTS
– mpirun.sh
– Par_file.T
– CMTSOLUTION
– specfem3d_globe.src.tgz (already in SE)
• OUTPUTS
– OUTPUT_FILES.tar.gz
• JDL
[
Executable = “mpirun.sh”;
CPUNumber = 144;
InputSandbox = { “mpirun.sh”, “Par_file.T”, “CMTSOLUTION” };
OutputSandobx = { “std.out”, “std.err”, “OUTPUT_FILES.tar.gz” }
Requirements = Member( “MPICH”,
other.GlueHostApplicationSoftwareRunTimeEnvironment );
]
12
13
1. Data Preparation
– SPECFEM Executable
– Earth Model
OR
– SPECFEM Source Package
2. Make a Job Description (use JDL)
– Parameter File (Parfile)
– Source (CMTSOLUTION)
3. Job Submission
Steps to run SPECFEM on the Grid
Submit a SPECFEM Job
14
submit job
sandbox
sandbox
dispatch job
replication info
query data
location (DLI)
find MPI
resources
Job Flow
Data Flow
INFO
specfem3d_globe.src.tgz
resource
characteristics
near SE
mpirun.sh
Par_file.T
CMTSOLUTION
15
List matched CEs for SPECFEM
16
Submit a SPECFEM Job (cont.)
Check Job Status
17
specfem3d_globe.src.tgz
mpirun.sh
Par_file.T
CMTSOLUTION
job status
INFO
job status
18
Status of the Submitted Jobs
19
The simulation is Running
20
The simulation is DONE
Retrieve Outputs
21
sandbox
sandbox
replication info
query data
location
Data Flow
INFO
3
update job status
OUTPUT_FILES.tgz
std.out
std.err
22
Retrieve Outputs (cont.)
23
Retrieve Outputs (cont.)
Simulation Gateway
• A portable Java GUI application that hides technical Grid
issues from seismologists and makes them easy to run
seismic simulations on the Grid
– No need to write any script or JDL file
– A Simulation Wizard helps setup up simulation
parameters
– A job monitoring interface
– A seismogram viewer to watch synthetic results
(diagrams are generated by SAC, Seismic Analysis Code)
Simulation Gateway Demo
Various Velocity Models User defined Events
Job Monitoring
Seismogram Viewer