DirBase: /shift/lxshare072d/data01/UIhome/grodid/CVS-tag6 Entering MainScript with arguments: =--forcingTB=CertTB --TGroup=SiteTesting_devel --verbose= at: Thu Sep 25 14:10:53 2003 ID: $Id: MainScript,v 1.29 2003/09/23 08:18:49 grodid Exp $ TAG: $Name: GG_20030923_1031 $ REVISION: $Revision: 1.29 $ SOURCE: $Source: /cvs/edg-tests/src/MainScript,v $ Tag for MainScript: GG_20030923_1031 Tag for edg-testbed-test: GG_20030923_1031 MainScript: setContext MainScript: checkArguments checkArguments help desc TList=s TGroup:s TUser MDebug fullHelp forcingVO:s forcingTB:s addOptionList=s forceMachineList=s addMachineList=s showME forceSubItem=i verbose! printDetails MainScript: setDefaults Setting default forcingVO = wpsix. Options: verbose 1 Options: TGroup SiteTesting_devel Options: forcingTB CertTB Options: forcingVO wpsix Check: with sh, sourcing /shift/lxshare072d/data01/UIhome/grodid/CVS-tag6/edg-tests/etc/test_site-CertTB.conf Check: with sh, sourcing /shift/lxshare072d/data01/UIhome/grodid/CVS-tag6/edg-tests/etc/edg-test.conf Asking for tests on: FTP_st CEGate_st MDS_ST UI_ST CECycle_st Entering Test: ===== FTP_st ===== #1 Begin test: FTP_st with: BaseTest::GridFTP on: lxshare0236.cern.ch lxshare0291.cern.ch Processing Command: edg-testbed-test BaseTest::GridFTP lxshare0236.cern.ch lxshare0291.cern.ch BaseTest: setContext GridFTP: setContext BaseTest: checkArguments BaseTest: setDefaults BaseTest: checkPrerequisites GridFTP: checkPrerequisites BaseTest: setupTest BaseTest: evaluateTest ==> BaseTest::parsing() ==> BaseTest::resultParser() BaseTest: runParserScript ==> BaseTest::runParserScript() Called buildStepFile() with /tmp/grodid-4022-GridFTPout After Parsing: local lxshare0236.cern.ch local lxshare0291.cern.ch lxshare0236.cern.ch lxshare0236.cern.ch lxshare0236.cern.ch lxshare0291.cern.ch lxshare0291.cern.ch lxshare0236.cern.ch lxshare0291.cern.ch lxshare0291.cern.ch BaseTest: cleanup End Test #1: FTP_st with: BaseTest::GridFTP on: lxshare0236.cern.ch lxshare0291.cern.ch Global Result: BaseTest::GridFTP [OK] Duration: 29 sec. ------------------------------------------------------------ Exiting Test: ===== FTP_st ===== Entering Test: ===== CEGate_st ===== #2 Begin test: CEGate_st with: BaseTest::GlobusGatekeeper on: lxshare0235.cern.ch lxshare0241.cern.ch Processing Command: edg-testbed-test BaseTest::GlobusGatekeeper lxshare0235.cern.ch lxshare0241.cern.ch BaseTest: setContext GlobusGatekeeper: setContext BaseTest: checkArguments BaseTest: setDefaults BaseTest: checkPrerequisites GlobusGatekeeper: checkPrerequisites BaseTest: setupTest GlobusGatekeeper: runTest Checking... lxshare0235.cern.ch Trying globus authentication...[OK] Trying globus-job-run...[OK] Trying globus-job-run with staging...[OK] Trying globus-job-submit...[OK] JobId: https://lxshare0235.cern.ch:20004/426/1064491903/ Random: 0.421578195450035 Testing job status... DONE Status...[OK] Check job output... 0.421578195450035 [OK]Clean up job...[OK] Trying globusrun (two_phase)...[OK] JobId: https://lxshare0235.cern.ch:20005/1346/1064491949/ Random: 0.774880452870043 Testing job status... DONE Status...[OK] Check job output...0.774880452870043 [OK] Clean up job...[OK] Checking... lxshare0241.cern.ch Trying globus authentication...[OK] Trying globus-job-run...[OK] Trying globus-job-run with staging...[OK] Trying globus-job-submit...[OK] JobId: https://lxshare0241.cern.ch:20001/21007/1064492010/ Random: 0.849161625045181 Testing job status... DONE Status...[OK] Check job output... 0.849161625045181 [OK]Clean up job...[OK] Trying globusrun (two_phase)...[OK] JobId: https://lxshare0241.cern.ch:20001/21881/1064492055/ Random: 0.517808528192369 Testing job status... DONE Status...[OK] Check job output...0.517808528192369 [OK] Clean up job...[OK] BaseTest: evaluateTest BaseTest: runXMLParserScript ==> BaseTest::GlobusGatekeeper::buildXMLFile1D() Called buildXMLFile() to write /tmp/grodid-4485-GatekeeperXML /bin/bash log2html-script.sh --outdir /tmp/grodid/030925-141053/cal_gatekeeper --outfile index.html --styledir /shift/lxshare072d/data01/UIhome/grodid/CVS-tag6/edg-tests/etc/parser_conf/html_style /tmp/grodid-4485-GatekeeperXML GlobusGatekeeper: cleanup BaseTest: cleanup End Test #2: CEGate_st with: BaseTest::GlobusGatekeeper on: lxshare0235.cern.ch lxshare0241.cern.ch Global Result: BaseTest::GlobusGatekeeper [OK] Duration: 222 sec. ------------------------------------------------------------ Exiting Test: ===== CEGate_st ===== Entering Test: ===== MDS_ST ===== #3 Begin test: MDS_ST with: BaseTest::CheckInfo::CheckGRIS on: -mdshost=lxshare0242.cern.ch -mdsport=2135 Processing Command: edg-testbed-test BaseTest::CheckInfo::CheckGRIS -mdshost=lxshare0242.cern.ch -mdsport=2135 BaseTest: setContext CheckInfo: setContext CheckGRIS: setContext BaseTest: checkArguments BaseTest: setDefaults Setting default mdsname = local. Setting default bdiihost = lxshare0410.cern.ch. Setting default bdiiport = 2170. Setting default bdiiname = local. BaseTest: checkPrerequisites BaseTest: setupTest CheckGRIS: runTest Trying... lxshare0235.cern.ch:2135 Trying... lxshare0236.cern.ch:2135 Trying... lxshare0241.cern.ch:2135 Trying... lxshare0247.cern.ch:2135 Trying... lxshare0277.cern.ch:2135 Trying... lxshare0278.cern.ch:2135 BaseTest: evaluateTest BaseTest: runParserScript CheckInfo: cleanup End Test #3: MDS_ST with: BaseTest::CheckInfo::CheckGRIS on: -mdshost=lxshare0242.cern.ch -mdsport=2135 Global Result: BaseTest::CheckInfo::CheckGRIS [OK] Duration: 1 sec. ------------------------------------------------------------ Begin test: MDS_ST with: BaseTest::CheckInfo::CheckTree on: -mdshost=lxshare0242.cern.ch -mdsport=2135 Processing Command: edg-testbed-test BaseTest::CheckInfo::CheckTree -mdshost=lxshare0242.cern.ch -mdsport=2135 BaseTest: setContext CheckInfo: setContext CheckTree: setContext BaseTest: checkArguments BaseTest: setDefaults Setting default mdsname = local. Setting default bdiihost = lxshare0410.cern.ch. Setting default bdiiport = 2170. Setting default bdiiname = local. BaseTest: checkPrerequisites BaseTest: setupTest CheckTree: runTest Processing: lxshare0242.cern.ch:2135 (Mds-Vo-name=local,o=grid) Processing: lxshare0242.cern.ch:2135 (Mds-Vo-name=lcgcert1, o=grid) Processing: lxshare0235.cern.ch:2135 (Mds-Vo-name=lcgcerttb1, o=grid) Processing: lxshare0235.cern.ch:2135 (Mds-Vo-name=local, o=grid) Processing: lxshare0241.cern.ch:2135 (Mds-Vo-name=local, o=grid) Processing: lxshare0236.cern.ch:2135 (Mds-Vo-name=local, o=grid) Processing: lxshare0277.cern.ch:2135 (Mds-Vo-name=lcgcerttb2, o=grid) Processing: lxshare0277.cern.ch:2135 (Mds-Vo-name=local, o=grid) Processing: lxshare0278.cern.ch:2135 (Mds-Vo-name=local, o=grid) Processing: lxshare0247.cern.ch:2135 (Mds-Vo-name=local, o=grid) BaseTest: evaluateTest BaseTest: runParserScript CheckInfo: cleanup End Test #3: MDS_ST with: BaseTest::CheckInfo::CheckTree on: -mdshost=lxshare0242.cern.ch -mdsport=2135 Global Result: BaseTest::CheckInfo::CheckTree [OK] Duration: 1 sec. ------------------------------------------------------------ Exiting Test: ===== MDS_ST ===== Entering Test: ===== UI_ST ===== #4 Begin test: UI_ST with: UI_config_test End Test #4: UI_ST with: UI_config_test Global Result: UI_config_test [OK] Duration: 23 sec. ------------------------------------------------------------ Exiting Test: ===== UI_ST ===== Entering Test: ===== CECycle_st ===== #5 Begin test: CECycle_st with: BaseTest::EDGLifecycle::Stack::CECycle on: --reqLapse=25 --maxSubs=6 --serie=923 --maxStack=25 --useCEList lxshare0286.cern.ch lxshare0241.cern.ch lcgce01.cern.ch Processing Command: edg-testbed-test BaseTest::EDGLifecycle::Stack::CECycle --reqLapse=25 --maxSubs=6 --serie=923 --maxStack=25 --useCEList lxshare0286.cern.ch lxshare0241.cern.ch lcgce01.cern.ch BaseTest: setContext EDGLifecycle: setContext ==> BaseTest::EDGLifecycle::Stack::setContext() ==> BaseTest::EDGLifecycle::Stack::CECycle::setContext() BaseTest: checkArguments BaseTest: setDefaults Setting default njobs = 1. Setting default nstreams = 1. Setting default eraseTemp = 1. Setting default zombSlep = 10. Setting default childTimeout = 1800. Setting default pollingPeriod = 30. Setting default resubmit = 1. BaseTest: checkPrerequisites EDGLifecycle: checkPrerequisites ==> BaseTest::EDGLifecycle::Stack::checkPrerequisites() ==> BaseTest::EDGLifecycle::Stack::CECycle::setupTest() ==> BaseTest::EDGLifecycle::Stack::setupTest() EDGLifecycle: setupTest Temporary directory: /tmp/grodid-9741-18767 CECycle: setupEnvironment ==> BaseTest::EDGLifecycle::Stack::stormSetup() CECycle: createScript CECycle: createJDL file script: /tmp/grodid-9741-18767/CECycle.jdl /tmp/grodid-9741-18767/CECycle.sh SUM Checking GG Type: CECycle Serie: 923 Jobs: 6 Date: @Thu_Sep_25_14:15:31_CEST_2003@ Delay: 25 and StackSize: 25 ==> BaseTest::EDGLifecycle::Stack::CECycle::buildCEList() Ready ? /tmp/grodid-9741-18767/CECycle.jdl /tmp/grodid-9741-18767/CECycle.sh CEs: lxshare0290.cern.ch:2119/jobmanager-lcgpbs-short lxshare0237.cern.ch:2119/jobmanager-lcgcondor-pool_for_grid lcgce01.cern.ch:2119/jobmanager-lcglsf-grid lxshare0241.cern.ch:2119/jobmanager-pbs-short lxshare0277.cern.ch:2119/jobmanager-pbs-short lxshare0235.cern.ch:2119/jobmanager-pbs-short lxshare0286.cern.ch:2119/jobmanager-pbs-short CE: lxshare0290.cern.ch CE: lxshare0237.cern.ch CE: lcgce01.cern.ch CE: lxshare0241.cern.ch CE: lxshare0277.cern.ch CE: lxshare0235.cern.ch CE: lxshare0286.cern.ch Selected CE: lcgce01.cern.ch:2119/jobmanager-lcglsf-grid Selected CE: lxshare0241.cern.ch:2119/jobmanager-pbs-short Selected CE: lxshare0286.cern.ch:2119/jobmanager-pbs-short OPTIONS: serie => 923 pollingPeriod => 30 njobs => 1 maxSubs => 6 childTimeout => 1800 useCEList => 1 maxStack => 25 zombSlep => 10 eraseTemp => 1 reqLapse => 25 resubmit => 1 nstreams => 1 ==> BaseTest::EDGLifecycle::Stack::runTest() ==> BaseTest::EDGLifecycle::Stack::CECycle::addArguments() Requirements: Requirements = other.GlueCEUniqueID=="lcgce01.cern.ch:2119/jobmanager-lcglsf-grid" Submit 0 9771 0 PID 0 / 6 9771 Starting the CHILD process: 9771 for timeout: 1800 sec. ZOMBIES 4 0 Reaper List: ==> BaseTest::EDGLifecycle::Stack::CECycle::addArguments() Requirements: Requirements = other.GlueCEUniqueID=="lxshare0241.cern.ch:2119/jobmanager-pbs-short" Submit 1 9796 0 PID 1 / 6 9796 Starting the CHILD process: 9796 for timeout: 1800 sec. ZOMBIES 4 0 Reaper List: ==> BaseTest::EDGLifecycle::Stack::CECycle::addArguments() Requirements: Requirements = other.GlueCEUniqueID=="lxshare0286.cern.ch:2119/jobmanager-pbs-short" Submit 2 9828 0 PID 2 / 6 9828 Starting the CHILD process: 9828 for timeout: 1800 sec. ZOMBIES 4 0 Reaper List: ==> BaseTest::EDGLifecycle::Stack::CECycle::addArguments() Requirements: Requirements = other.GlueCEUniqueID=="lcgce01.cern.ch:2119/jobmanager-lcglsf-grid" Submit 3 9868 0 PID 3 / 6 9868 Starting the CHILD process: 9868 for timeout: 1800 sec. ZOMBIES 4 0 Reaper List: ==> BaseTest::EDGLifecycle::Stack::CECycle::addArguments() Requirements: Requirements = other.GlueCEUniqueID=="lxshare0241.cern.ch:2119/jobmanager-pbs-short" Submit 4 9916 0 PID 4 / 6 9916 Starting the CHILD process: 9916 for timeout: 1800 sec. ZOMBIES 4 0 Reaper List: ==> BaseTest::EDGLifecycle::Stack::CECycle::addArguments() Requirements: Requirements = other.GlueCEUniqueID=="lxshare0286.cern.ch:2119/jobmanager-pbs-short" Submit 5 9964 0 PID 5 / 6 9964 Starting the CHILD process: 9964 for timeout: 1800 sec. ZOMBIES 5 0 Reaper List: 9916 SUM flag=>Trying_submission, index=>4, date=>Thu_Sep_25_14:17:16_CEST_2003, jobid=>https://lxshare0234.cern.ch:9000/OmAApRz4GptOyZ7njq_XPQ SUM flag=>Outname, index=>4, olout=>/tmp/grodid-9741-18767/CECycle-4.out, mawn=>lxshare0244.cern.ch SUM flag=>Status, index=>4, jdl=>/tmp/grodid-9741-18767/tmparg-4.jdl, date=>Thu_Sep_25_14:17:16_CEST_2003, none=>30, none=>lxshare0244.cern.ch, none=>2.4.20-18.7smp, none=> , stat2=>SUCCESS, stat1=>[OK] ZOMBIES 1 0 Reaper List: 9796 SUM flag=>Trying_submission, index=>1, date=>Thu_Sep_25_14:16:01_CEST_2003, jobid=>https://lxshare0234.cern.ch:9000/NzqT2ItdaxeAYLRymVJ1bw SUM flag=>Outname, index=>1, olout=>/tmp/grodid-9741-18767/CECycle-1.out, mawn=>lxshare0244.cern.ch SUM flag=>Status, index=>1, jdl=>/tmp/grodid-9741-18767/tmparg-1.jdl, date=>Thu_Sep_25_14:16:01_CEST_2003, none=>120, none=>lxshare0244.cern.ch, none=>2.4.20-18.7smp, none=> , stat2=>SUCCESS, stat1=>[OK] ZOMBIES 1 0 Reaper List: 9828 SUM flag=>Trying_submission, index=>2, date=>Thu_Sep_25_14:16:26_CEST_2003, jobid=>https://lxshare0234.cern.ch:9000/n4eFL7wj26i330mb1r8h9Q SUM flag=>Outname, index=>2, olout=>/tmp/grodid-9741-18767/CECycle-2.out, mawn=>lxshare0296.cern.ch SUM flag=>Status, index=>2, jdl=>/tmp/grodid-9741-18767/tmparg-2.jdl, date=>Thu_Sep_25_14:16:26_CEST_2003, none=>120, none=>lxshare0296.cern.ch, none=>2.4.18-27.7.x.cernsmp, none=> , stat2=>SUCCESS, stat1=>[OK] ZOMBIES 1 0 Reaper List: 9964 SUM flag=>Trying_submission, index=>5, date=>Thu_Sep_25_14:17:41_CEST_2003, jobid=>https://lxshare0234.cern.ch:9000/UrhkYJ6n9o-9elg1SiTkCg SUM flag=>Outname, index=>5, olout=>/tmp/grodid-9741-18767/CECycle-5.out, mawn=>lxshare0296.cern.ch SUM flag=>Status, index=>5, jdl=>/tmp/grodid-9741-18767/tmparg-5.jdl, date=>Thu_Sep_25_14:17:41_CEST_2003, none=>60, none=>lxshare0296.cern.ch, none=>2.4.18-27.7.x.cernsmp, none=> , stat2=>SUCCESS, stat1=>[OK] Signal ALRM received0: 9771 Timeout in SubmitUtils: at /shift/lxshare072d/data01/UIhome/grodid/CVS-tag6/opt/edg/bin/SubmitUtils.pm line 116. ZOMBIES 1 0 Reaper List: 9771 SUM flag=>Trying_submission, index=>0, date=>Thu_Sep_25_14:15:36_CEST_2003, jobid=>https://lxshare0234.cern.ch:9000/nzUlo7TJePOHJrPqQxpi8g SUM flag=>Status, stat2=>TIMEOUT, stat1=>[FAIL] Signal ALRM received0: 9868 Timeout in SubmitUtils: at /shift/lxshare072d/data01/UIhome/grodid/CVS-tag6/opt/edg/bin/SubmitUtils.pm line 116. ZOMBIES 1 0 Reaper List: 9868 SUM flag=>Trying_submission, index=>3, date=>Thu_Sep_25_14:16:51_CEST_2003, jobid=>https://lxshare0234.cern.ch:9000/CpLOuKdISP-KbiyRhH6TOg SUM flag=>Status, stat2=>TIMEOUT, stat1=>[FAIL] We are done with 6 6 0 SUM Ending GG CECycle: serie 923: We are done with 6 6 ==> BaseTest::EDGLifecycle::Stack::CECycle::evaluateTest() ==> BaseTest::EDGLifecycle::Stack::evaluateTest() SUMM 0 : date => Thu_Sep_25_14:15:36_CEST_2003 jobid => https://lxshare0234.cern.ch:9000/nzUlo7TJePOHJrPqQxpi8g mace => lcgce01.cern.ch pid => 9771 stat1 => [FAIL] stat2 => TIMEOUT SUMM 1 : date => Thu_Sep_25_14:16:01_CEST_2003 jdl => /tmp/grodid-9741-18767/tmparg-1.jdl jobid => https://lxshare0234.cern.ch:9000/NzqT2ItdaxeAYLRymVJ1bw mace => lxshare0241.cern.ch mawn => lxshare0244.cern.ch olout => /tmp/grodid-9741-18767/CECycle-1.out pid => 9796 stat1 => [OK] stat2 => SUCCESS SUMM 2 : date => Thu_Sep_25_14:16:26_CEST_2003 jdl => /tmp/grodid-9741-18767/tmparg-2.jdl jobid => https://lxshare0234.cern.ch:9000/n4eFL7wj26i330mb1r8h9Q mace => lxshare0286.cern.ch mawn => lxshare0296.cern.ch olout => /tmp/grodid-9741-18767/CECycle-2.out pid => 9828 stat1 => [OK] stat2 => SUCCESS SUMM 3 : date => Thu_Sep_25_14:16:51_CEST_2003 jobid => https://lxshare0234.cern.ch:9000/CpLOuKdISP-KbiyRhH6TOg mace => lcgce01.cern.ch pid => 9868 stat1 => [FAIL] stat2 => TIMEOUT SUMM 4 : date => Thu_Sep_25_14:17:16_CEST_2003 jdl => /tmp/grodid-9741-18767/tmparg-4.jdl jobid => https://lxshare0234.cern.ch:9000/OmAApRz4GptOyZ7njq_XPQ mace => lxshare0241.cern.ch mawn => lxshare0244.cern.ch olout => /tmp/grodid-9741-18767/CECycle-4.out pid => 9916 stat1 => [OK] stat2 => SUCCESS SUMM 5 : date => Thu_Sep_25_14:17:41_CEST_2003 jdl => /tmp/grodid-9741-18767/tmparg-5.jdl jobid => https://lxshare0234.cern.ch:9000/UrhkYJ6n9o-9elg1SiTkCg mace => lxshare0286.cern.ch mawn => lxshare0296.cern.ch olout => /tmp/grodid-9741-18767/CECycle-5.out pid => 9964 stat1 => [OK] stat2 => SUCCESS SUMM 6 : mawn => MATCHING olout => /tmp/grodid-9741-18767/matching.out stat1 => [OK] SUMM 7 : mawn => RUNNING olog => /tmp/grodid-9741-18767/running.out stat1 => [FAIL] ==> BaseTest::parsing() ==> BaseTest::resultParser() BaseTest: runXMLParserScript ==> BaseTest::EDGLifecycle::Stack::buildXMLFile1Col() Called buildXMLFile1Col() to write /tmp/grodid-9741-18767/CECycle.XML /bin/bash log2html-script.sh --outdir /tmp/grodid/030925-141053/CECycle --outfile index.html --styledir /shift/lxshare072d/data01/UIhome/grodid/CVS-tag6/edg-tests/etc/parser_conf/html_style /tmp/grodid-9741-18767/CECycle.XML ==> BaseTest::EDGLifecycle::Stack::cleanup() EDGLifecycle: cleanup End Test #5: CECycle_st with: BaseTest::EDGLifecycle::Stack::CECycle on: --reqLapse=25 --maxSubs=6 --serie=923 --maxStack=25 --useCEList lxshare0286.cern.ch lxshare0241.cern.ch lcgce01.cern.ch Global Result: BaseTest::EDGLifecycle::Stack::CECycle [FAIL] Duration: 1886 sec. ------------------------------------------------------------ Exiting Test: ===== CECycle_st ===== BaseUtils: buildCover HTML in: /tmp/grodid/030925-141053/index.html TarBall in: lxshare0276.cern.ch /tmp/grodid/030925-141053/tarex.tgz Leaving: MainScript at: Thu Sep 25 14:46:56 2003 Duration: 2163 sec.