WMS test report

Summary

• Component: WMS 3.3.3

• Savannah task: 21777

• ETICS Subsystem Configuration Name: emi-wms_R_3_3_5_1

• VCS Tag: glite-wms-wmproxy_R_3_3_3_0

• EMI Major Release: EMI 1 (Kebnekaise)

• Platform: sl5 epel

• Certification report: WMS-3-3-3_Certification_Report.txt

• Outcome: Certified

Clean installation

• Starting from a SL5 x86_64 kernel machine:

[root@cream-44 ~]# cat /etc/redhat-release
Scientific Linux SL release 5.6 (Boron)
[root@cream-44 ~]# uname -a
Linux cream-44.pd.infn.it 2.6.18-238.5.1.el5xen #1 SMP Tue Mar 1 19:22:01 EST 2011 x86_64 x86_64 x86_64 GNU/Linux

• cd /etc/yum.repos.d/
• wget --no-check-certificate https://twiki.cern.ch/twiki/pub/EMI/EMI1Updates/testing.repo
• yum clean all
• yum install ca-policy-egi-core
• yum install emi-wms
  o See log file
• /opt/glite/yaim/bin/yaim -c -s /usr/local/nfs/jra1_test/cream-44/site-info_wms.def -n WMS
  o See log file

Update

• Starting from a production version:

[root@cream-48 yum.repos.d]# cat /etc/emi-release
EMI release 1.0 (Kebnekaise)
[root@cream-48 yum.repos.d]# cat /etc/emi-version 
1.1.2-1

• wget --no-check-certificate https://twiki.cern.ch/twiki/pub/EMI/EMI1Updates/testing.repo -O /etc/yum.repos.d/testing.repo
• yum clean all
• yum update
• /opt/glite/yaim/bin/yaim -c -s site-info.def -n WMS
• yum update
  • See log file
• /opt/glite/yaim/bin/yaim -c -s /usr/local/nfs1/jra1_test/cream-48/site-info_wms.def -n WMS
  • See log file

Test Report

List Match

List match without data

===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS Job ListMatch Testing 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Test 1: check if glite-wms-job-list-match command exists 


 Test 2: test a simple matching 


 Test 3: check --delegationid option 


 Test 4: exclude a CE from the match 


 Test 5: try a failure matching (Requirements == false) 

===> 
===> Test: WMS-listmatch-test.py
===> WMS: devel11.cnaf.infn.it
===> Started: 23:07:24
===> Ended  : 23:07:32
===> 
===>     === test PASSED === 
===> 

Test log file is WMSService-TS_20110803230724.log

Submission

Normal job

===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general) 


 Test 1A: Submit to an LCG-CE 


 Test 1B: Submit to a CREAM CE 


 Test 1C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: devel11.cnaf.infn.it
===> Started: 23:30:43
===> Ended  : 23:36:29
===> 
===>     === test PASSED === 
===> 

Test log file is WMSService-TS_20110803233043.log

Collection job

===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Set 2: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general) 


 Test 2A: Submit to an LCG-CE 


 Test 2B: Submit to a CREAM CE 


 Test 2C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: devel11.cnaf.infn.it
===> Started: 23:47:25
===> Ended  : 00:05:59
===> 
===>     === test PASSED === 
===> 

Test log file is WMSService-TS_20110803234725.log

Parametric job

===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Set 3: Submit a parametric job (3 cases LCG-CE, CREAM, general) 


 Test 3A: Submit to an LCG-CE 


 Test 3B: Submit to a CREAM CE 


 Test 3C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: devel11.cnaf.infn.it
===> Started: 13:58:29
===> Ended  : 14:47:14
===> 
===>     === test PASSED === 
===> 

Test log file is WMSService-TS_20110804135829.log

DAG job

===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Set 4: Submit a DAG job 

===> 
===> Test: WMS-job-cycle.py
===> WMS: devel11.cnaf.infn.it
===> Started: 08:47:32
===> Ended  : 08:54:44
===> 
===>     === test PASSED === 
===> 

Test log file is WMSService-TS_20110804084732.log

Parallel job

===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Set 5: Submit a MPI job (3 cases LCG-CE, CREAM, general) 


 Test 5A: Submit to an LCG-CE 


 Test 5B: Submit to a CREAM CE 


 Test 5C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: devel11.cnaf.infn.it
===> Started: 14:34:21
===> Ended  : 14:40:40
===> 
===>     === test PASSED === 
===> 

Test log file is WMSService-TS_20110804143421.log

Perusal job

 +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Set 6: Submit a perusal job 


 BEWARE default min perusal interval is 1000 secs, so this phase could take many minutes 

===> 
===> Test: WMS-job-cycle.py
===> WMS: devel11.cnaf.infn.it
===> Started: 14:45:51
===> Ended  : 15:15:17
===> 
===>     === test PASSED === 
===> 

Test log file is WMSService-TS_20110804144551.log

Cancel

===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS Job Cancel Testing 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Test 1: Try to cancel a normal job 


 Test 2: Try to cancel a DAG job 


 Test 3: Try to cancel one node of a DAG job 


 Test 4: Try to cancel a collection job 


 Test 5: Try to cancel one node of a collection job 


 Test 6: Try to cancel a parametric job 


 Test 7: Try to cancel one node of a parametric job 

===> 
===> Test: WMS-job-cancel.py
===> WMS: devel11.cnaf.infn.it
===> Started: 10:02:38
===> Ended  : 10:05:22
===> 
===>     === test PASSED === 
===> 

Test log file is WMSService-TS_20110804100238.log

Others

Delegation

===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test delegation operation 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 1: Check --autm-delegation option 


 Test 2: Check --delegationid option 


 Test 3: Try to delegate with a short proxy and check the validity 


 Test 4: Works with expired proxy 

===> 
===> Test: WMS-delegation-test.py
===> WMS: devel11.cnaf.infn.it
===> Started: 10:10:17
===> Ended  : 10:11:32
===> 
===>     === test PASSED === 
===> 

Test log file is WMSService-TS_20110804101017.log

Prologue/Epilogue

===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS test prologue and epilogue attributes 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Test 1: Test prologue attribute 


 Test 2: Test epilogue attribute 


 Test 3: Test prologue and epilogue attributes 

===> 
===> Test: WMS-prologue-epilogue.py
===> WMS: devel11.cnaf.infn.it
===> Started: 10:15:23
===> Ended  : 10:23:14
===> 
===>     === test PASSED === 
===> 

Test log file is WMSService-TS_20110804101523.log

Test proxy renewal

===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS test proxy renewal operation 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 1: Test proxy renewal with LCG CE 


 Test 2: Test proxy renewal with CREAM CE 

===> 
===> Test: WMS-proxy-renewal.py
===> WMS: devel11.cnaf.infn.it
===> Started: 12:51:25
===> Ended  : 13:26:21
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20110804125125.log

Test log file is WMSService-TS_20110804125125.log

Shallow/Deep Resubmission

===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS Job Resubmission Testing 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Test 1: Try a shallow resubmission 


 Test 2: Try a deep resubmission 

===> 
===> Test: WMS-job-resubmit.py
===> WMS: devel11.cnaf.infn.it
===> Started: 13:37:19
===> Ended  : 13:49:59
===> 
===>     === test PASSED === 
===> 

Test log file is WMSService-TS_20110804133719.log

Published information

bdb database definitions

• ldapsearch -x -H ldap://cream-44.pd.infn.it:2170 -b 'o=grid'

Stats database definitions

• ldapsearch -x -H ldap://cream-44.pd.infn.it:2170 -b 'o=infosys'

Outrput is xx

GLUE 2.0 database definitions

• ldapsearch -x -H ldap://cream-44.pd.infn.it:2170 -b 'o=glue'

Check Bugs (Regression tests)

Bug #85071: wmproxy authorization breaks with longer proxy chain FIXED

[sgaravat@cream-50 JDLExamples]$ myproxy-init -d
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Massimo Sgaravatto
Enter GRID pass phrase for this identity:
Creating proxy .......................................................................................... Done
Proxy Verify OK
Your proxy is valid until: Wed Aug 10 22:58:21 2011
Enter MyProxy pass phrase:
Verifying - Enter MyProxy pass phrase:
A proxy valid for 168 hours (7.0 days) for user /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Massimo Sgaravatto now exists on myproxy.cnaf.infn.it.

[sgaravat@cream-50 JDLExamples]$ myproxy-logon -d --voms dteam
Enter MyProxy pass phrase:
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Massimo Sgaravatto/CN=proxy/CN=proxy/CN=proxy
Contacting  voms2.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr] "dteam" Done
Creating proxy ...................................................................................................................................... Done

Your proxy is valid until Thu Aug  4 09:58:55 2011
A credential has been received for user /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Massimo Sgaravatto in /tmp/x509up_u500.

[sgaravat@cream-50 JDLExamples]$ glite-wms-job-submit -a -c devel11.conf env.jdl
 
Connecting to the service https://devel11.cnaf.infn.it:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://devel11.cnaf.infn.it:9000/COeI00lCmz6T6e-0ylEUyA

==========================================================================

Trying the same towards a WMS without this fix:

$ glite-wms-job-submit -a -c devel09.conf env.jdl

Connecting to the service https://devel09.cnaf.infn.it:7443/glite_wms_wmproxy_server


Warning - Unable to delegate the credential to the endpoint: https://devel09.cnaf.infn.it:7443/glite_wms_wmproxy_server
AuthorizationException: Authorization error: user not authorized
        at
checkGaclUserAuthZ()[/builddir/build/BUILD/glite-wms-wmproxy-3.3.2/build/../src/authorizer/wmpauthorizer.cpp:417]
        at
checkGaclUserAuthZ()[/builddir/build/BUILD/glite-wms-wmproxy-3.3.2/build/../src/authorizer/wmpauthorizer.cpp:282]
        at authorize()[/builddir/build/BUILD/glite-wms-wmproxy-3.3.2/build/../src/authorizer/wmpauthorizer.cpp:150]
        at getProxyReq()[/builddir/build/BUILD/glite-wms-wmproxy-3.3.2/build/../src/server/wmpoperations.cpp:627]



Switching to next WMProxy Server...

Error - Operations failed
Unable to find any endpoint where to perform service request

-- MassimoSgaravatto - 2011-08-03