GRID ENGINE COMMUNITY UPDATE
Joachim Gabler QA Manager Sun Grid Engine
1 Overview
• Status gridengine.sunsource.net • New Projects > ARCo > Hedeby > Testsuite • Site Statistics • QA Information > Testsuite > Bug / RFE Statistics
Sun Confidential: Internal Only 2 Status gridengine.sunsource.net (1)
• ~ 700 Members • Mailing lists > [email protected] > [email protected] > [email protected] > [email protected] > [email protected] > [email protected] > [email protected]
Sun Confidential: Internal Only 3 Status gridengine.sunsource.net (2)
• Size of content / code > ~ 60MB (10 MB binary, 50MB ascii) > ~ 8500 files > ~ 1.5 Million lines (1 Million code + 0.5 Million documentation) • Documentation > on gridengine.sunsource.net > on docs.sun.com
Sun Confidential: Internal Only 4 New Projects - ARCo
• 26 Members • Mailing Lists > announce, users, dev, issues from gridengine project > [email protected] • Size of content / code > ~ 3MB (0.5MB binary, 2.5MB ascii) > ~ 900 files > ~ 66000 lines (code + documentation) • Documentation > on docs.sun.com
Sun Confidential: Internal Only 5 New Projects – Hedeby (1)
• 24 Members • Mailing Lists > [email protected] > [email protected] > [email protected] (very active) > [email protected] > [email protected] + cvs mailing lists for sub projects • Size of content / code > ~ 30MB (10MB binary, 20MB ascii) > ~ 3.600 files > ~ 400.000 lines (code + documentation)
Sun Confidential: Internal Only 6 New Projects – Hedeby (2)
• Sub Projects > hedeby-config-center > hedeby-n1sm-adapter > hedeby-ge-adapter > hedeby-security > ...
Sun Confidential: Internal Only 7 New Projects - Testsuite
• 19 Members • Mailing Lists > [email protected] > [email protected] > [email protected] • Size of content / code – ~ 5MB (0.4MB binary, 4.6MB ascii) – ~ 1.500 files – ~ 160.000 lines of code • Documentation not yet public
Sun Confidential: Internal Only 8 Other Grid Engine related Projects
• drmaa4ruby.sunsource.net > DRMAA binding for Ruby • Passau Grid Engine XML Parser > http://passau.dev.java.net > Java API for accessing qstat output via JAX-B • OpenDSP > http://sourceforge.net/projects/opendsp > Remote job management via secure DRMAA/JSDL framework • ComputeServer > http://computeserver.dev.java.net > Framework for distributed Java applications on Grid Engine
Sun Confidential: Internal Only 9 WEB Traffic Statistics
• grPaidegneg hiniets.s gurindseonugrcinee.n.esut nsource.net / week 90000page hits / week (?) •85mo000 derate growth 80000 75000 70000
65000 Hits 60000 55000 50000
45000 40000 06 0 2007 2007 2007 2007 2005 2006 2006 2 2006 - - - - 07 07 01- 04 09- 10- 01- 04 10-
Sun Confidential: Internal Only 10 Project Members
Members of gridengine.sunsource.net 800
775
750
725
700 Members
675
650
625
600 7 07 06 007 2007 2007 2007 2007 20 2007 2 200 2006 2006 2006 2006 20 2006 ------1- 07 07 01- 02- 03 04 05- 06 08 08- 09- 10- 1 12-
Sun Confidential: Internal Only 11 Mailing List Traffic
• avg pretty constant hedeby dev posts/month dev • high traffic on users users 800 mailing list 750 700 650 • hedeby 600 development 550 500 discussions in 450 400 opensource 350 300 • core system 250 200 development 150 100 discussions mostly 50 7 7 5 6 6 0 5 5 6 07 07 05 05 06 06 06 00 0 00 0 00 0 0 00 005 00 0 00 0 00
internal 00 0 2 2 2 2 2 - -2 -2 -2 -2 - - - -2 -2 - -2 3 7 7 9 5-2 5-2 1-2 1-2 03 0 03 0 0 09 07 0 01 0 01 0 11 0 05 1
Sun Confidential: Internal Only 12 Users Mailing List – Top 10 Contributors (June – July 2007) (1) Reuti (151) (2) Rayson Ho (108) (3) Daniel Templeton (98) (4) Andreas Haas (47) (5) Andy Schwierskott (42) (6) John Hearns (38) (7) Lönroth Erik (34) (8) Iwona Sakrejda (29) (9) Margaret Doll (27) (10) Fred Youhanaie (23)
Sun Confidential: Internal Only 13 CVS Statistics
• core cvs checkins / month > including Testsuite 375 private until Sep 2006 350 hedeby 325 testsuite arco • arco (> Dec 2006) 300 core 275 250 • testsuite (> Sep 2006) 225 200 • hedeby (> Dec 2006) 175 150 • private (before OS) 125 100 > arco 75 > hedeby 50 25 > windows port 0 6 007 2 2007 2007 2007 2005 2005 2005 2005 2005 2005 2006 2006 2006 2006 200 2006 ------07 07 07 01- 03 05 01- 03 05 09- 11- 01- 03 05 09- 11-
Sun Confidential: Internal Only 14 Community Contributions
• mailing lists, lots of support • gridengine.info (Chris Dagdigian) • Bug reports, partly with full evaluation and patches • development projects > ssh Tight Integration (Ron Chen) > FlexLM Loadsensor Integration (Mark Olesen) > Array Job Dependencies (Rising Sun Pictures) > others
Sun Confidential: Internal Only 15 Grid Engine Testsuite (1)
• Technology > TCL/expect > TDOM package for XML parsing > remote execution via rlogin or ssh • Scope > core system (installation, daemons, all clients except qmon) > arco (installation, dbwriter, cmdline tools, Junit tests) > hedeby (installation, cmdline clients, Junit tests) > all supported platforms > all setup options (spooling, csp, admin user, ...)
Sun Confidential: Internal Only 16 Grid Engine Testsuite (2)
• Tested Functionality > cvs checkout > build + create packages > install cluster, ARCo, Hedeby > run test scenarios – module tests (Junit, C module tests) – all options of all binaries – use cases – performance – fixed bugs
Sun Confidential: Internal Only 17 Grid Engine Testsuite (3)
checks • checks consist of multiple Number of test scenarios check_functions
check_functions 700 650 • many test enhancements, 600 e.g. negative tests 550 500 • testsuite framework 450 enhancements 400 350 • core system testsuite 300 250 • ARCo testsuite 200 150 • hedeby testsuite 100 50 0 5 6 5 5 5 6 6 6 7 7 7 7 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 2 2 2 2 2 2 2 2 2 2 2 2 ------0 9 0 1 4- 7 1 4 7 1 4 7 0 0 0 0 1 0 0 0 1 0 0 0
Sun Confidential: Internal Only 18 Issues / Change Requests
• 2 sources of information > Issuezilla (gridengine.sunsource.net) > Bugster (former Bugtraq, SUN tool, more fine grained info) • Some numbers (based on Bugster): > Total (open) 1959 (486) > Bugs (open) 1690 (309) > RFE's (open) 269 (177)
Sun Confidential: Internal Only 19 CR's Fixed / Introduced per Release
325 300 275 250 225 200 175 fixed 150 introduced 125 100 75 50 25 0 0 1 2 4 6 8 9 0 1 1 u u u 1 1 6. 6. 0u7 0u2 0u3 0u5 0u u u .0u1 .1u 6. 6 6. 6. 6.0 6. 6.0 6.0 6. .0 6.1u 6 6 6.0
Sun Confidential: Internal Only 20 Open Bugs (Aug 2007)
Open Bugs by subcategory and priority
75 70 65 60 P5 55 50 P4 45 P3 40 P2 35 P1 30 25 20 15 10 5 0 i l l r l o n a n n n g ts e u c o 8 a a n te n g n i r l ti tio s 1 r sta e i a m m i u a u a e r l n i c c d k c i d m e e n q x h u e sc m m o c
Sun Confidential: Internal Only 21 Open Bugs and RFE's (Aug 2007)
Open bugs and RFE's by priority
275
250
225 RFE's Bugs 200
175
150
125
100
75
50
25
0 2 3 1 5 P P P P4 P
Sun Confidential: Internal Only 22 GRID ENGINE COMMUNITY UPDATE
Joachim Gabler [email protected]
23