INTERNATIONAL UNION for the PROTECTION of NEW VARIETIES of PLANTS Geneva

E UPOV/WG-DST/4/2 ORIGINAL: English DATE: February 2, 2016 INTERNATIONAL UNION FOR THE PROTECTION OF NEW VARIETIES OF PLANTS Geneva

WORKING GROUP FOR THE DEVELOPMENT OF A UPOV DENOMINATION SIMILARITY SEARCH TOOL

Fourth Meeting Geneva, February 4, 2016

REPORT OF THE WG-TEST STUDY AND POSSIBLE USE OF A UPOV DENOMINATION SIMILARITY SEARCH TOOL WITHIN UPOV

prepared by the Office of the Union

Disclaimer: this document does not represent UPOV policies or guidance

EXECUTIVE SUMMARY

1. The purpose of this document is to report the results of the second step of the Test Study in order to improve the algorithm for the UPOV denomination similarity search tool and to propose the next steps in the development of the UPOV denomination similarity search tool.

2. The WG-DST is invited to consider the proposed next steps for the development of the UPOV denomination similarity search tool, as set out in paragraph 21 to this document.

3. The structure of this document is as follows:

EXECUTIVE SUMMARY ...... 1 BACKGROUND ...... 1 DEVELOPMENTS SINCE THE THIRD MEETING OF THE WG-DST ...... 2 PROPOSED NEXT STEPS ...... 3

ANNEX I: Responses to the second step of the Test Study ANNEX II: Examples for filters to remove duplicated types of similar denominations ANNEX III: List of denominations that two or more contributors selected as possibly similar ANNEX IV: List of denominations that none of one contributors selected as possibly similar

4. The following abbreviations are used in this document:

CAJ: Administrative and Legal Committee CAJ-AG: Administrative and Legal Committee Advisory Group TC: Technical Committee WG-DST: Working Group for the Development of a UPOV Denomination Similarity Search Tool

BACKGROUND

5. The background to this matter is provided in document UPOV/WG-DST/3/2 “Report of the WG-DST Test Study and possible use of a UPOV denomination similarity search tool within UPOV”.

6. The WG-DST, at its third meeting, held in Geneva on October 2, 2015, noted that the algorithms selected from the first step of the Test Study had produced too many denominations that were above the UPOV/WG-DST/4/2 page 2 cut-off value for similarity (low precision). The reason for the low precision was that the number of non-similar denominations identified in the first step of the test study was too small and the types of non-similar denominations too narrow in diversity.

7. The WG-DST, at its third meeting, agreed as a revised second step, in order to improve the precision of the selected algorithm(s), to run the selected algorithms on the PLUTO database with the 20 test denominations used in the first test study and to produce lists of the denominations above the cut-off value. Members of the Union would then be invited to identify denominations above the cut-off values that were not so similar that they would require further, individual consideration before deciding if they were (sufficiently) different from existing denominations (see Article 20(2) 0 -of the 1991 Act and Article 13(2) of the 1978 Act).

8. The WG-DST, at its third meeting, also received information from Mr. Glenn Mac Stravic that the best algorithms selected by recombination of standard search algorithms could be significantly improved by customization by a suitable expert. Given the long-term benefits of developing the most effective search tool possible, the WG-DST agreed that the Office of the Union should seek to develop a customized algorithm as a further step. It noted that the customization would not be effective unless there was sufficient analysis by denomination experts in the revised second step of the Test Study.

9. The WG-DST, at its third meeting, agreed on the following timetable for the above exercise as follows:

(a) Issue a circular to invite CAJ designated persons of the members of the Union by October 6 inviting them to participate in the second step of the Test Study with a deadline of November 4; (b) Produce a refined algorithm by December 2; and (c) Produce a customized algorithm by December 31, 2015.

10. The WG-DST agreed that the feed-back by users on the customized algorithm should be considered at the fourth meeting of the WG-DST. In that regard, the Office of the Union would invite the members to test the customized algorithm when it became available.

DEVELOPMENTS SINCE THE THIRD MEETING OF THE WG-DST

11. In accordance with the program agreed by the WG-DST, at its third meeting, the Office of the Union issued Circular E-15/237, on October 21, 2015, inviting members of the Union to participate in the second step of the Test Study for the development of an effective denomination similarity search tool. A web page for the Test Study, containing 20 Test Denominations and denominations for each of the Test Denominations selected by the best algorithm proposed at the first step of the Test Study was prepared for the work.

12. A summary of the responses to the second step of the Test Study is attached as Annex I to this document. There was considerable diversity in the number of denominations that were selected as similar and further investigations revealed that there was not a very high coincidence in the denominations selected as similar.

13. In order to seek to develop a list of denominations that could be accepted as similar by the participating experts, a further exercise was proposed by Circular E-15/291, on December 21, 2015, to the WG-DST and the respondents to the exercise of the second step of the Test Study.

14. For each test denomination, a list of denominations selected as similar by at least two experts in the second step of the Test Study was prepared. Alongside that list, a further list of denominations that were only selected by one expert was presented. The denominations that were not selected as similar by any expert in the second step were excluded.

15. In order to minimize the work required in this additional exercise, the lists of denominations was filtered to remove duplicated types of similar denominations. The method for removing duplicated types of similar denomination is explained in Annex II.

16. Participants were requested to indicate if they considered if any of the denominations that were previously selected by only one expert should be considered as similar by a UPOV denomination similarity search tool.

UPOV/WG-DST/4/2 page 3

17. Annex III to this document presents the list of denominations that were selected by more than one expert as similar, and are, therefore proposed to be the basis for similar denominations in refining the algorithm.

18. Annex IV to this document contains the denominations that were not endorsed as similar by any experts in the additional exercise and, therefore, are proposed to be considered as non-similar denominations for the purpose of refining the algorithm.

19. All the contributors to the second step of the Test Study contributed to the additional exercise. In addition a further three experts contributed to the additional exercise.

20. The preliminary view of Mr. Glenn Mac Stravic on the data on Annex III and IV was that it would provide a suitable basis for refining the algorithm. However, it is not possible to predict how much improvement in performance of the algorithm would be achieved.

PROPOSED NEXT STEPS

21. The following steps are proposed for the development of a UPOV denomination similarity search tool;

(a) Refine the algorithm obtained from the first step of the Test Study using the data in Annexes III and IV of this document;

(b) If the performance of the refined algorithm is sufficient, an expert would be invited to customize the algorithm for further improvement. The customized algorithm would be presented for testing by members of the Union with data in the PLUTO database later in 2016. Specific dates would be proposed at the WG-DEN, to be held in Geneva, on March 18, 2016; and

(c) If the performance of the refined algorithm is not sufficient, the deficiencies of the refined algorithm will be analyzed. A further exercise might be required according to the deficiencies of the refined algorithm. A proposal will be prepared for consideration at the WG-DEN meeting, to be held in Geneva, on March 18, 2016.

22. The WG-DST is invited to consider the proposed next steps for the development of the UPOV denomination similarity search tool, as set out in paragraph 21 to this document.

[Four Annexes follows

UPOV/WG-DST/4/2

ANNEX I

SUMMARY OF RESPONSES TO THE SECOND STEP OF THE TEST STUDY

Name ALADINBaptystaChara CodisolarDivva Estel FlavorgioJosefineKadet M67 NN-9812AEPirate Rugby Sienna SnowplanetSweet CarolineTopaz SweetVictoire HeartWaverider PurpleYounique

Contributor 1 8 Contributor 2 62 189 154 271 206 199 417 151 232 67 4 58 698 45 689 37 241 334 328 135 Contributor 3 32 28 45 38 49 76 53 36 Contributor 4 9 6 17 21 35 56 9 82 30 2 15 51 31 13 6 49 94 8 65 Contributor 5 45 11 92 160 210 116 237 39 75 60 1 51 579 33 522 10 179 22 250 35 Contributor 6 44 10 54 25 76 107 10 77 28 9 2 30 265 36 4 7 137 18 16 15 Contributor 7 3 4 2 3 6 9 3 7 4 1 4 3 3 2 2 5 2 2 4 Contributor 8 39 13 112 28 77 61 65 32 63 2 6 Contributor 9 8 5 7 5 6 6 1 5 1 1 2 2 3 2 2 3 2 7 2 Contributor 10 28 51 41 44 69 3 1 Contributor 11 8 5 3 4 7 5 3 6 2 8 5 5 3 3 5 5 6 4 Contributor 12 7 2 1 8 9 13 4 6 6 2 2 5 7 2 2 8 3 9 18 Contributor 13 2 3 3 6 6 7 2 20 7 48 2 12 8 11 9 26 22 39 25 16 Contributor 14 15 81 6 7 10 17 3 23 17 1 3 10 10 Contributor 15 27 14 19 28 10 5 12 16 3 1 6 11 10 4 7 20 7 8 27 Contributor 16 2 1 Contributor 17 32 49 18 58 Contributor 18 7 7 12 11 30 28 10 22 23 1 27 1 Contributor 19 18 Contributor 20 31 24 68 34 38 Contributor 21 29 12 28 30 1 26 Contributor 22 16 6 30 25 Contributor 23 1 Contributor 24 34 760 30 6 91 199 28 27 104 Contributor 25 3 4 4 3 2 3 4 3 5 Contributor 26 1 Contributor 27 17 8

No. of Contributors 22 16 15 16 17 15 14 15 14 7 14 13 14 13 12 12 17 14 14 15 "Possibly similar" denominations per contribution 22 28 41 43 54 48 56 35 38 27 2 17 173 17 105 16 58 45 51 32

Total contributors 27 Contributions per Test Denomination 14.5

[Annex II follows] UPOV/WG-DST/4/2

ANNEX II

EXAMPLES FOR FILTERS TO REMOVE DUPLICATED TYPES OF SIMILAR DENOMINATIONS

Example 1: structure

The test denomination is “FLAVORGIO”. The following denominations are in the same structure;

- FLAVOR + XOXX (X=any of letters not used in the test denomination); FLAVORHOME FLAVORBOMB FLAVORBOND FLAVORZONE.. etc. - XOX + FLAVOR JOYFLAVOR TOPFLAVOR…etc.

Denominations with the same structure are regarded as the same group of denominations, and one denomination representing the group will be in the list of denominations:

FLAVORHOME (representing “FLAVOR + XOXX” structure) JOYFLAVOR (representing “XOX + FLAVOR” structure)

Example 2: location and use of letters

The test denomination is “FLAVORGIO”. The following denominations have letter “A” in their last three letters (“A” is included in the test denomination (FLAVORGIO)).

FLAVORASE FLAVORCAN FLAVORDNA

These denominations could be different if the algorithm considers the positions of letters; therefore, these denominations are treated as different groups. These denominations will be in the list of denominations.

In the case of “FLAVORSET”, none of the letters in the last three letters exists in the test denomination: this is regarded as a different group from the denomination “FLAVORASE”, “FLAVORCAN” and “FLAVORDNA”.

The following denominations have “FLAVOR + Z + AVOR” structure (Z=any of letters): “L” is included in the test denomination (FLAVORGIO) but “S” is not; therefore, these are different groups.

FLAVORLAVOR FLAVORSAVOR

The test denomination is “KADET”. In the case of following denominations, “BANET” and “BODET” will be in the list.

BANET BODET BARET CARET

“BANET” has “A” which is included in the test denomination (KADET) but not “D”, and “BODET” has “D” but not “A”, and the location of these letters (“A” for “BANET”: 2nd letter and “D” for BODET”: 3rd letter) is different. Therefore, these denominations are regarded as different groups.

“BARET” is regarded as the same group as “BANET” because neither of the different letters (“R” for “BARET” and “N” for “BANET”) are included in the test denomination.

UPOV/WG-DST/4/2 Annex II, page 2

“CARET” is regarded as the same group as “BANET” because none of the different letters (“C” & “R” for “CARET” and “B” & “N” for “BANET”) are included in the test denomination.

[Annex III follows]

UPOV/WG-DST/4/2

ANNEX III

LIST OF DENOMINATIONS THAT TWO OR MORE CONTRIBUTORS SELECTED AS POSSIBLY SIMILAR

Cells with yellow highlights were selected by contributors in the additional exercise. Sweet Caroline Sweet ALADIN Baptysta Chara Codisolar Divva Estel Flavorgio Josefine Kadet M67 NN-9812AE Pirate Rugby Sienna Snowplanet Topaz Victoire Waverider Younique Heart Purple ABIADIN Aprista AAHARA ACODISOLAR ADIVVA U.S.TEL ALL OUT FLAVOR F JOSESIN ADET M 0930 ENUENU-9821EI AIRATE AV-Ruby AC Sierra *SNOWPLAST BM TOPLAZ FICTOIRE ACE RIDER B.UNIQUE PLMAGE PURPLE

ACADDIN BAPE STA ACARA AION SOLAR DAIVA T-ESTER BIG FLAVOR BLOG GEOSEFINE CADAT M 1 ENUENU-9821EII AQUAPARK OPIRATE EDRUGBY BIENNA ANALOG PLANET DOPAZ LE RAYON DES VICTOIRES ALEX RIDER B3YOUNIQUE 2011KAWAMO PURPLE

ADALIN BAPTIST ACCHARA AMERICAN CHOICE SOLAR DAVA STELE BRING THE FLAVOR HOME GEOSEPHINE CADE M 108 NN-9812AA CAPIRATE ERUGBY CHIENNA BALLOON PLANET LA COMPAGNIE DE PUBLICATION MUSICALE TOPAZ...CO. REGISTERED V VICTOR ATV RIDER DUO UNIQUE AIMAMU PURPLE RED Adelin BAPTISTA ACHAR APPOLLO SOLAR Davia Steel BRINGING FLAVOR TO LIFE GIOSEFINA CADEL M 11 NN-9812AE EL PIRATO INTERNATIONAL RUGBY10S CIENNE BANDPLANET LOPAS V VICTORIA BABE RIDER EMUNIQUE Carline ALACTIN BAPTISTA'S AJCHARA ARCO SOLAR DEIVA STEAL COLOR AND FLAVOR SHOP JJ JOSEPHINE JOANNE CADEN M 112-321 NN-99131A EPIRATE LUGBY Jesienna BIG SHINY PLANET MS. TOPAZIO V VICTORIA V BACKRIDER ES Unic Carolien ALADAN BAPTISTIKA C CARA AUSTRALIA WIDE SOLAR Dia PREESTEL ECO FLAVOR BOWL O JOCCELINE Cadet M 137 NN-B9821A FLYER PIRAT.CH MYRUGBY LIENNA KWS BINGO PLANET NUTOPAZ V VICTORY BIKE RIDER EUNIQUE Carolin Aladdin's Treasure BAPTISTS ON MISSION C CHARC AXIO SOLAR Diava MESTEL F FLAVOR INFUSED JOSEFANNY CADETS M 150 HIRATE PUGBY S SENNA BIO PLANET OOPAZZ VECTOIRE Black Rider GUESTS OF UNIQUE PEOPLE CAROLINA ALADDINZ BAPTYSTA CARA BIG DOG SOLAR Dida L'ESTREL FARMING FOR FLAVORS JOSEFIN CADETTE M 16 HYRATE R RUBY S SIENA BIO PLANETE POPPAZ VICKTOR BLUE WAVE BRAND I AM UNIQUE CAROLINASWEET ALADDYN'S BAPUTISTA CARAT BIOSOLAR DIFFA L'ESTELLE Flavor JOSEFINA CADET-THE UNIFORM PEOPLE M 180 IRATE REGBI SCENA BODY PLANET ST.TOPAZ VICKTORIYA BLUE WAVE MICRO I M UNIQUE CAROLINE'S CITRINE ALADEN BARISTA CCHRA BLACK FROG SOLAR Dika LESTEL FLAVOR AGE JOSEFINA'S CADIT M 183 LA BANDA DI PARATE RGB+Y SCIENAT BONEPLANET T0PAZ VICTOILE CITRIC BARE RIDER I UNIQUE CAROLYN ALADI BARON BAPTISTE'S POWER YOGA CEARA BLUE CHIP SOLAR DILVA Leste FLAVOR AGED JOSEFINE CADJET M 2 PARITE RGBEE SCIENNA BONES PLANNET Tapas VICTOIR LADY DARE RIDER ICONIC BY UNIQUE VINTAGE Carolynne Jane ALADIA Batist CH ART BOYD SOLAR O DIV@ J STEEL FLAVOR AID JOSEFINENKRONE CADUET M 209 PIERATE RHUBY SEI ENNA BOOK PLANET TAPOZ VICTOIRE DOUBLE WAVE PINK IONIQ Confetti Purple AL-ADIL BATISTA CH Nara CALISOLAR Diva EZYTEL FLAVOR ALL JOSEFINI Calet M 2101 PILATE RHUDBY SEIENNA BOONIEPLANET TAPPAZ VICTOR DRAKERIDER IONIQUE CORSO PURPLE Aladin BATISTA-LON CHAAR CALORSOLAR CERATI Divadona EZTL FLAVOR ANN JOSEFINO CODET M 225 PILATES RHUGBY SEINA BYOPLANET TEPPAZ VICTOR EK DUNERIDER I-UNIQUE TV DELICACY PURPLE ALADINA BATISTAR CHABA CET SOLAR STORE DIVE-! Eztela FLAVOR ART JOSEFINOS IZZY KADETZ M 25 PIPRAT RIGBEE SENHA CAN PLANET THOPAZ VICTO'REE EASY WAVE PINKMARBLE Jannica Delidante Purple ALADINATE BATISTA'S CHABRA Cherry Solar Divia EZTEL FLAVOR BIRD I JOSEFINU IZZY KADETZ'S M 258 PIPRATE RIGBY SENIA CHAINPLANET THOPAZE VICTOREEN EASY WAVE RED Jonica E.Heart ALA-DINER Batisti CS CHACA CHODISOLAR Divina EZETEL FLAVOR BLUSH JOSELIN K DIET M 26 PIRAAT RIGBY'S SENNA S CINE PLANET TIPAZ VICTORI EDGERIDER JONIQUE Fresh/Heart ALADINHOTEL Batistuta CHACRA CHODISOLARE Divio Excel FLAVOR BOSS JOSELYN K KAMET M 27 PIRAME RUBBY SENNA-C COCO PLANET TOBAZ VICTORIA (W 357) FIRE WAVE JOU-NIQUE GL Karoline ALADINMILD BAUTISTA CHAKA CICLOSOLAR DIVJA ETELLE FLAVOR CAP Josephina KADDEO M 274 PIRATA RUBEE SHIENA COSMO PLANET Tomas Victoria 2000-F Firerider JUNIQUE HALLOWEEN PURPLE ALADINO BAZPITA CHAKRA CIGSOLAR DIVNA Etela FLAVOR CIG JOSEPHINA'S KADEE M 276 PIRATAS RUBI SIANA COTTON PLANET TOMASZ VICTORIA B. GOODE RIDER LE SEUL ET UNIQUE Hart ALADIP J.BAUTISTA CHANA CITISOLAR DIVVAB ETEL FLAVOR DUO Josephine KADETA M 280 PIRATE RUBY. W Siena DINO PLANET TOPA VICTORIA EG GUIDED WAVE RADAR LE UNIQUE HEARTSWEET ALADN MBATTISTA CHAOA CITYSOLAR DIVVAD Eszter FLAVOR EDGE JOSEPHINE_ENLIVEN YOUR INNER PEACE Kadett M 30010 PIRATE3D Rubygo I SIENDA DISCO PLANET TOPAC VICTORIA II Heat Wave Grape LI UNIQUE NET HERT AL-ADNIN THE BAPTISTE CHAR Q CLOUD SOLAR DIVVAI ESTYLE FLAVOR FALLS JOSEPHINENHUTTE KADETTE M 313 PIRATEBAY RUBY'S SIENE DONK PLANET TOPACIO VICTORIA ONE HEAT WAVE ORCHID Lunique HEURT ALADVIN Chara COBRA SOLAR DIVVALI ESTREL FLAVOR FILD JOSEPHINES KADLED M 320 PIRATE-BOX RUBYX SIENN DOORS PLANET Topas VICTORIA P. Heat Wave White MIO UNIQUE HAIR CARE KAROLIN ALADYS CHARABAND CODICLAR DIVVAV ESTLE DE' LEON FLAVOR FIRM JOSEPHINO'S KADOET M 327 PIRATEER RUDBI SIENNADO Early Snow Balla TOPASA VICTORIA ROSE IWAVEWIRED NETEXX ID UNIQUE SYSTEM PETUEPO PURPLE ALAEDDIN CHARABIA CODICLEAR DIVVI ESTL FLAVOR FLAG JOSEPINE KAET M 3325 PIRATEEYE RUDBY SIENNARA FROSTY THE SNOW PLANT TOPASE Victoria SP INTA LINE RIDER NEUNIQUE PHOENIX PURPLE ALAIN CHARABY Codifar DOVA ES'TILE FLAVOR FLIP JOSSEPH KAGET M 335 PIRATELAB RUGB SIENNA'S MARK. LLC Frozen Planet TopAssis VICTORIA TSE LIVERIDER ONE UNIQUE RESOURCE Precious Hearts ALANIN CHARAC CODISCAN Dove ESTIL FLAVOR FLOSS JOZEFIN KAIDETTE M 4 PIRATELOOT RUGBEE SIENNAX GL Planet TOPASU VICTORIA V LOVE RIDER Q UNIQUE Red Heart ALATEEN CHARACASS CODISCOS DVVA ESTHEAL FLAVOR FORK JOZEFINU KATE'K M 40162 PIRATEN SCHMAUS RUGBIE SIENNI HOOPZ PLANET INFO Topaz VICTORIA-ASTER MACH RIDER RKO UNIQUE SANHANA PURPLE ALDEN CHARACHUTE CODISERA EDIVVA ESTES FLAVOR FRY JUSFINE KA-TET M 418 PIRATENET Rugby SIENNY IMPERIAL SNOW CENTER TOPAZA VICTORIA-FCA NEW WAVE MEDIA SHUNIQUE SOUTHERN PURPLE ALDIN CHARA-COVERS CODISOL Godiva ESTER-O FLAVOR GATOR JUSTFINE K-DEL M 44-14 Pirati RUGBYNRT SIERNNA INFOPLANET TOPAZE Victorian OVENRIDER TOP UNIQUE MODEL Sweet Caroline Sweet Caroline Sweet ALDINI CHARACTEARS CODISOLAR CL IDIVVA ESTERE Flavor Gem JUZEFINE K-DET 'M 44-14' PIRET RUGBYWEB SIESA ION PLANET TOPAZIA Victorie OVERIDER TOUNIQUE Heart Purple Sweet Caroline Sweet ALDINNA CHARACULA CODISOLARA Iva ESTER-C FLAVOR GENIE Rosafine KEDETTES M 48 PIRETTE Rugbyxx SILENA IRONPLANET TOPAZO VICTORIES PALE RIDER ALE U UNIQUE Heart Red SWEET CAROLINE ALDINO CHARADE CODISOLARE Ladiva Ester FLAVOR GIRLS TJOSEFINE KIDDET M 488 PIRROTE RUGGLY SINNA KIDS PLANET TOPAZOL VICTORINE PALM RIDER UA UNIQUE AUTOSPORTS SWEET YELLOW

SWEET CAROLINE ALEDEN CHARADECK CODISOLARI Mediva ESTEN FLAVOR GLIDES TOSEFIN KIDETS M 56-231 PIRT RUGGY SIONNA KIWI PLANET TOPAZONE VICTORIO PATHRIDER UE UNIQUE ESTATES SWEETHEART PURPLE SWEET CAROLINE ALIDINE CHARADES CODISOLARIE NIVA ESTELU FLAVOR GOD YOSEFIN S KODET-SE M 60 PITRAT RUGGY'S CAR SIRENA LESSON PLANET TOPES VICTORI'S RAVE RIDE THE WAVE UN UNIQUE SWEETHEART RED SWEET HEART CANDY ALLADID CHARAE' CODISOLARIUM SOUTH COAST DIVA'S ESTELPLAN FLAVOR GODDESS YOSEFINS PT-17 KAYDET M 66 PRAT RUGZY SLIENNA MINORPLANET TOPEZ VICTORITE RED RIDER UNIC SHOPS ALLADIN-AIR A CHARAH CODISOLARO Thiva ESTELLE'S FLAVOR GOLD Yosofie QUADET M 7 PRATE Ruigyber SSENNA MISS TEEN PLANET TOPGAZ VICTORIYA SAFERIDER Unik Sweethart ALLALIN Charai CODISTAR VIVA ESTELLE FLAVOR GRILL PLUS ZYOZEFINU QUADETTE M 70 PRIMATE RUMBY Syene MONEY PLANET TOPOS VICTOROY SALT RIDER Unique Sweetheart SWEETHEART(FLAMIN ALLDYNE CHARAKANI CODIZOL CL ESTELLA'S FLAVOR GROWN QUDET M 8 PURATE UGBY THE SIERRA MYPLANET TOPPAH VICTORS SHOCK WAVE IVORY UNIQUE-PH GO) (ARC#1671) ALMADIN CHARAL COL SOLARE ESTELLA FLAVOR GURU M 9 PYRAT Vienna NAIL PLANET TOPZ VICTORVICTORIA SIDERIDER UNIQUE'S ALODINE CHARAMUSCA COLT SOLAR TECHNOLOGY ESTELIUM FLAVOR HOPS M 9507 Pyrite NEO PLANET TUPAS VICTORY STORM WAVE CUTTER Utique ALODYNE CHARANGE COMMSOLAR ESTELITE FLAVOR HUB M 9560 WWW.PIRATE INSURANCE.COM NEON PLANET TUPEZ VICTORY III Summer Wave Blue Yanique ALUDIN Charano CONTI SOLAR ESTELITA FLAVOR ICE M.26 X-PIRATE NETPLANET ZOPRAZ VICTORY'S SUMMER WAVE SILVER YONIQUE Amandin CHARANTIA COOLSOLAR ESTELINK FLAVOR INN M.4 NEXT PLANET OVER ZZ/TOPZ VICTTORIUM SURERIDER YOONIC ANADIN CHARAP COTUIT SOLAR ESTELF FLAVOR KINGS M.9 NEXX PLANET VIKTOR SWELLRIDER YOONIQ Andain CHARAPA CPC SOLAR ESTELEX FLAVOR KISS M0822 NINE PLANET VIKTORE TELERIDER YOU NIQUE ARLIDIN CHARASA CROWN SOLAR ESTELENE FLAVOR MAGIC M-1 NOBLE PLANET VIKTORI TIDAL WAVE RIVER YOUNIC ATING ALAMIN CHARATAN CSI/SOLAR ESTELASE FLAVOR MAID M-105 NOISY PLANET VIKTORIA TRADE RIDER YOUNIQ BLADIN' CHARA-TOON CREATIONS & CO DIE SOLAR PROFIS ESTELARIS FLAVOR MAX M106 NOSHPLANET Viktoriana VIBE RIDER YOUNIQUELY 4U CITALADIN ChARAVNITSA ECO R SOLAR ESTELAR FLAVOR MOR M-11 NOWPLANET.TV Viktorie WADER AIDER YOUNIQUELY-U EALADDIN.COM CHARBA ECOAPPSOLAR ESTELADON FLAVOR OASIS M116 OFF PLAN PLANET VIKTORIJA WAIVERAÃ•DERE YOU-NIQUES GLADIN CHARI ECODISOLAR ESTELADO FLAVOR PRO M1215 ON PLANET ME VIKTORIO WAIVERADER YOUNITE LADAIN Charis ECOSOLAR Estel FLAVOR R RESOURCES M1249 ONE PLANET NO BORDERS VIKTORIYA WAIVERADERE YOUR UNIQUE BUSINESS CARD LE JARDIN D'ALADIN CHARL. ECOVO SOLAR ESTEF-PR FLAVOR SAVIOR M-207 ONE PLANET THINKING Viktorka WAIVERAIDER YOUTIQUE EDISON SOLAR ELECTRIC LYRALADIN CHAROU ESE ESTEAL FLAVOR SAVOR O M-208 OPENPLANET Viktorya WAIVERIDER YOYUNIKU MY ALADDIN.COM CHARQ FOLDA SOLAR ESTE FLAVOR SHOT M2093 PANT PLANET Vittorea WAIVERIDERE YUKINE FRENCH KNIT SOLAR OLADIN CHARRAS PROTECTOR ESTAL FLAVOR SPA M26 PENTOL PLANET Vittorio WAKERIDER YUNIC. OLADINE CHARRUA FUBI SOLAR EPF ESSEL S L FLAVOR TIGHT M-36 PINK PLANET VYKTOIRE WAKERIDERS CO YUNIKE PALADIN CHEARA GET YOUR SOLAR ON ESSEL FLAVOR TOPS M4 PLATE AND PLANET Wiktoria WARM RIDER COLLECTION YUNIQUE GEMZ PALADINE CHERRA GO AZ SOLAR ESS ELLE FLAVOR UNIT M-502 POND PLANET WATERAIDER YUUNIKU PHALADINO CHIARA GREAT BROOK SOLAR ESPIEL FLAVOR VAPOR M50676 PRISON PLANET WAVE BANNER Saladyn CHIURA GREEN GOLD SOLAR ESPEL FLAVOR WELL M-60 Red Planet WAVE CRADLE TESALADIN CHORA CAPITAL HOKUSOLAR ESDELLE FLAVOR YOUR DREAMS M66 RGT Planet WAVE DIMMER Christmas Charn I NEED SOLAR ERTHEL FLAVOR/EDGE M7 ROCK N ROLL PLANET WAVE DRAPE CHYRA ICODISOLAR ELTEL NETWORKS FLAVORA M77 ROCK PLANET WAVE DRIVE CIARA ICOSOLAR EASTEEL FLAVORADIOS S SNOWFLAKE STUDIOS WAVE FEEDER CLARA INCODISOLAR E ESTELLA FLAVORAL SENIOR PLANET WAVE FLIER CLARA (A-232) INDO SOLAR DIESTEL FLAVORAMA SHOWPLANET WAVE GLIDER CUCHARA JORISOLAR B BESTEL FLAVORASE SIGNA PLANET POP WAVE GRIPPER DHARA KACO SOLAR AYSTEL FLAVORATOR SKI PLANET WAVE JAMMER ECHARA KODISOLAR Astell FLAVORAVE SNACK PLANET WAVE KILLER EL CHARRO KODISOLARE FlavorBlush SNOPLANST WAVE LASER CENTER ESCHARA LOCK SOLAR FLAVORBOM TOBACCO SNOW MARBLE WAVE LINERS HARA LONG SOLAR FLAVORCAL SNOW ACCENTS WAVE OF LIFE Jara METISOLAR FLAVORCAN Snow and Ice WAVE RACER K.CHARA MICODISOLAR FLAVORCCINO SNOW ANGEL WAVE RADIO KIARA MOMMISOLAR FLAVORCOAT SNOW ANGELUS WAVE RAIDER MG7 COARA MONDIASOLAR FLAVORCOCK Snow Anne WAVE RAYDER PHARA MOREE SOLAR FLAVORCOFFEE SNOW APPLE WAVE RIDER SACHARA MOTOSOLAR Flavorcrest snow baby WAVE RIDING VEHICLES Sara MOXIE SOLAR FLAVORDNA Snow Beauty WAVE RIPPERS SCHARA OCODISOLAR FLAVORE Snow Belle WAVE RITE Scharo OMCO SOLAR FLAVORELLA SNOW BLADES WAVE ROBBER SHAIRA OMNISOLAR Flavorfall SNOW BLANKET WAVE ROSE HAKURYU SHAR ONDUSOLAR FLAVORFAX Snow Bliss WAVE ROWER SHARA OPALSOLAR FLAVORFILL Snow Bride WAVE SIREN Share OPEL SOLAR FLAVORFLO SNOW CANDY HARUKA WAVE STRIDER GTX SHARO OPTISOLAR FLAVORFUL HEAT Snow Cap WAVE TRAIN SHCHARA OSLA SOLAR FLAVORFULV SNOW CAP ALE WAVE VIDEO SHIARA PODER SOLAR FLAVORFY SNOW CARPET WAVE WARRIOR Shira POLARSOLAR FLAVORGARD Snow Cloud WAVE WEED CONTROL SHYRA POLYSOLAR FLAVORGATE SNOW COLLAGEN WAVE WELDER Xsara POTIZSOLAR FLAVORGIA SNOW DANCER WAVEBENDER XUCHARA PRECODISOLAR FLAVORGIE Snow Deholta WAVEBITERS Zara PROAIR SOLAR FLAVORGII SNOW DELITE WAVEBRIDGE ZHARA QUODISOLAR FLAVORGLO Snow Diamond WAVEBUILDER QWIKSOLAR FLAVOR-GLOW SNOW DOME WAVECARRIER READY TO GO SOLAR FLAVORI SNOW DUCHESS WAVECEIVER RECODISOLAR FLAVORICE SNOW EATER WAVECODER ROBIN SOLAR FLAVORICH Snow Egret WAVEDIRECT ROL SOLAR TINTING FLAVORIFFIC SNOW ELANI WAVEDRAWER ROLASOLAR FLAVORINA Snow Fairy WAVEDRIVER SAN DIEGO SOLAR FLAVORINE SNOW FLIRT WAVEFARER SCHOTT SOLAR Flavorino SNOW FLOAT WAVEFILTER SET FOR SOLAR FLAVORINOS Snow Framint WAVEFINDER SOLAR ORO FLAVORISTA Snow Gem WAVEFISHER SOLD ON SOLAR FLAVORITA SNOW GIANT WAVEGRIP SOLISOLAR Flavorite Snow Grace WAVEHALER SOPRASOLAR FLAVORITES Snow Green WAVEHUMMER THINSOLAR Flavoriti SNOW HARP WAVELIDER TIER DROP SOLAR FLAVORIZONS Snow Head WAVELINE V TINDO SOLAR FLAVORJIO Snow Heart WAVENEY TODOSOLAR FLAVORKING SNOW ISLAND WAVEPACER TOTESOLAR FLAVORLAB Snow January WAVEPOWER TPPI SOLAR FLAVORLATOR Snow Jewel WAVEPRINT TWIN SOLAR FLAVORLEAF Snow King WAVERAÃ•DERE VINO SOLAR CABERNET SAUVIGNON FLAVORLIFFT Snow Kist WAVERACE WINDSOLAR FLAVORLOCK SNOW LAB TV WAVERADER

WORLD SOLAR CHALLENGE FLAVOROL SNOW LABEL MARK WAVERADERE YOGA SOLAR FLAVOROLOGY Snow Lace WAVERAIDERS FLAVORONE SNOW LINE WAVERAIL FLAVOROS Snow Love WAVERATOR Flavorosa Snow Magic WAVERAVE FLAVORPAL O SNOW MAIDEN WAVERCISE FLAVOR-PIT Snow Man WAVEREADER SPIN FLAVORROAD SNOW MANTA WAVEREADY FLAVORS2GO SNOW MANTLE WAVEREFLEX FLAVORSAVOR SNOW MANTRA WAVEREN FLAVORSET Snow March WAVERIDERS FLAVORSOL SNOW MARRIAGE WAVERIDERS.ORG FLAVORTINI SNOW MATES WAVERIGHT FLAVORTOP Snow Moker WAVERING FLAVORVAC Snow 'n' Frost WAVERIPPER FLAVORVILLE Snow 'n Ice WAVERITAS FV FLAVOR VAPES SNOW ORANGE Waverley HEMP FLAVOR ECIG SNOW PAINT WAVEROUTE HUNT FOR FLAVOR SNOW PALACE WAVEROUTER J JOY FLAVOR SNOW PALS WAVE-RYDER JOY FLAVOR SNOW PANDA WAVESAVER LIVING FLAVOR V SNOW PANTHER WAVESERVER MIXED FLAVOR SODA SNOW PARADISE WAVESLICER OPTIMIZOR BRAND FLAVOR O SNOW PASSION Wavestar PARK FULL FLAVOR P SNOW PEAK SP WAVETRADE UPOV/WG-DST/4/2 Annex III, page 2

Cells with yellow highlights were selected by contributors in the additional exercise. Sweet Caroline Sweet ALADIN Baptysta Chara Codisolar Divva Estel Flavorgio Josefine Kadet M67 NN-9812AE Pirate Rugby Sienna Snowplanet Topaz Victoire Waverider Younique Heart Purple PHLAVORGIO SNOW PEARL WAVETRADER PHLAVORJIO SNOW PEOPLE WAVETRAIN

SUPERPRETZEL FLAVOR DUOS SNOW PHANTOM WAVETRENDS THE FLAVOR GUY SNOW PHONE WAVETRIBE WE FLAVOR THE WORLD SNOW PILOT WAVEVIEW WORLDS OF FLAVOR ASIA Snow Pixie WAVEWIRE SNOW PLATE WAVEWRAPPER SNOW PLOWERS WAVEWRITER Snow Pride WEB RIDERZ SNOW PRINCE WEVERAÃ•DER SNOW PRINCESS WEVERAÃ•DERE SNOW PULSE WEVERADER Snow Purple WEVERADERE SNOW RIPPLE WEVERIDER Snow River WEVERIDERE Snow Rose WHALE RIDER SNOW SANGO WHEEL RIDER SNOW SATIN SNOW SPINNER SNOW STATION Snow Sunny Pearl Snow Supreme SNOW SWEAT Snow Sweet SNOW VALLEY SNOW VIEW SNOW VILLAGE SNOWALKERS SNOWAPPEL SNOWBALL PRESS Snowbank SNOWBEL 1524 SNOWBLADE SNOWBLAST SNOWBLASTER 2000 SNOWBLAZER SNOWBLIND Snowboard Snowbound Snowbred Snowbrite Snowcharm Snowchaser SNOWCLEAN SNOWCLEAN E MIX SNOWCLONES Snowcone Snowcones White Snowcrest SNOWDANCE Snowden Snowdon Snowdrift Snow-Dwarf SNOWFAAME Snowfall Snowfire Snowflake SNOWFLAKES SNOWFLANE SNOWFLATES SNOWFLITE O Snowflower SNOWFLUENT Snowfly Snowglenn SNOWICANE SNOWLANDER Snowleaf SNOWLETS DESIGN SNOWLINE BRAND SNOWMAPLE Snowmass SNOWMASTER Snowpack SNOWPACT SNOWPARADE SNOWPARROT Snowpeak SNOWPEAK SNOW PEAK SNOWPEN AIR SNOWPENAIR SNOWPETAL SNOWPLACEN SNOWPLANET SNOWPLAY NOSY BEAR SNOWPOINT SNOWPOLE SNOWPRANET SNOWPRINTS SNOWPROTEC SNOWQUEEN SNOWRENTAL SNOWSCENTS SNOWSNAKE DERBY SNOWSNAKER Snowsong Supreme SNOWSPACE Snowspire SNOWSPRITE Snowstar Snowtan Snowwhite SNOWY POINT SOS PLANET INTERNATIONAL SOUND PLANET SOWPLANNER SOXPLANET SOZO PLANET SP SONIC PLANET SPARKLE SNOWLAND SPINPLANET STONE PLANET SUNNY PLANET EYEWARE SUNPLANET SOLAARIUMIKESKUS SWAPLANET SWISS SNOW LEAGUE TENTH PLANET PRODUCTIONS THE SNOW CONNECT THERE SNOW PLACE LIKE TOON PLANET PARK Tridiette Snowgoose TS SNOW FRERE TWEENPLANET VIRGIN SNOW APPAREL VROOM PLANET WINDOWPLANET WINEPLANET WOM PLANET WOOW PLANET WRONG PLANET YULETIDE SNOW HAMLET [Annex IV follows] IUUPOV /UPOV/WG-DST/4/2

ANNEX III

LIST OF DENOMINATIONS THAT TWO OR MORE CONTRIBUTORS SELECTED AS POSSIBLY SIMILAR

Cells with yellow highlights were selected by contributors in the additional exercise. Sweet Caroline Sweet ALADIN Baptysta Chara Codisolar Divva Estel Flavorgio Josefine Kadet M67 NN-9812AE Pirate Rugby Sienna Snowplanet Topaz Victoire Waverider Younique Heart Purple PHLAVORGIO SNOW PEARL WAVETRADER PHLAVORJIO SNOW PEOPLE WAVETRAIN

ANNEX IV

LIST OF DENOMINATIONS THAT NONE OR ONE CONTRIBUTORS SELECTED AS POSSIBLY SIMILAR

ALADIN Baptysta Chara Codisolar Divva Estel Flavorgio Josefine Kadet M67 NN-9812AE Pirate Rugby Sienna Snowplanet Topaz Victoire Waverider Younique Sweet Caroline Sweet Heart Purple Arlekin BAPTISCARE SUPER CHARRO NO COST SOLAR SYSTEM Dvina SEETEL DO ME A FLAVOR JODEFINA INTA KAFETTE MK 267 S TANROSILB (NAAS BOTHA) E-Z ASPIRATE EARUGBY EUCLIDE AVRIDOR Iena NEW PLANET AGRICULTURE STAPLES TO AZ PILOT SHOP VILLA VICTORIA Arider COMUNIQUE Sweet Jumbo Adair Baptistine IHARA MILBEX CODISMART Codival EYESTIL FLAVORED TO THE BONE SEFINE M-4906 Pyrit RINOPLANETT Tapiz VICTORIA'S GARDEN ADVERRIDERS BEUNIQUE SWEETE Aydin 2002 Bailsta Cheri CODILOR Vivia Esmer FLAVORS YOU CRAVE HGC Josef Lemper M 176-213 PARITA FASHION BODY SOUL PLANET 'DPAZ16' VICTRIO Wavette BIOUNIQUE SWEET'S Shaiera CODICOSA Vaiva Apostel FLAVO DROP Josie 51 M SNOWS LAKE WINERY Topazio RR KH Viktor WAVERO IMMUNIQUE SWEAT SCHIRA CODIDOXAL Aviva Fastel FLAVOCORM Yoshine MP3 MADE IN OUR PLANET Voraz Victoria Red Gaby WAVE DRIVEN MARKETING SERVICES SOIE-ET-TOI BE[YOU]NIQUE SWEETA SHARAI CODIGOAL Kivia ES Tales M 119-153 APPROCHE DE ANNA PLANET LOPAZO Victoria Emma WAVERSAVER EUNIQUE'S PIZZA EXPRESS "EAT TO A HEALTHIER BEAT" SWEETY Cherie CODIDOL Defo Ves Yel 90M02 RESCUE FROM PLANET ZERO Torcaz RB-VICTOR Wavertop Yoshine Sweeto CH-ARRAYAN CODISIL Dufy TESYEL M-38 SWATCH SNOWPASS SNOW PASS VIKTOR'S Wave King Akebono Yoannika T-SWEET T-CHAKRA CODICOL Tuva PASTELLE M 48-42 SNOW CLOSE TO HOME VICTORY-V Waverplus Winnica SWEED CHELA ALMAN CHOUR I SOLAR Pensel THIS IS YOUR PLANET VIKUTOAARU COOL WAVE SLIDE Swit Tschaka CODILAC GENUINE CANADIAN SNOW SNAKES VICTORINO DIGITAL WAVEGUIDE TOUCH Q`SWEET Jouhara CODINOL DOWN TO PLANET EARTH VINKOR BLUEWAVE WATER IDEAS A.SWEET. Thira (OUD) CODIPLAY S3 SNOW SKATE SURF VIKUTOWARU C.E.O OVERRIDER'S Sweent 'n Pink MEDISOLARE SNOWPLICITY SNOWPLOWING MADE SIMPLE Victoriana Lovely River SWEET'N LOW CODISCO ODYSSEE SNOW AND SEA Victorious Blue Waves AU-Sweet Scarlet CODILSA SLED DOGS SNOWSKATES VICTORINUS HEAT WAVE SUPER QUIET Hearty CODIPRAL THE ULTIMATE SNOWSKATE VIKTORINA RACERIDE CAROLENA TSUBAKIHIME CODCOSOL ONCE UPON A PLANET NKVICTORY WAVEBIRD WAVE BIRD Sweet-Creek CODISCOPE DJ BOBO PLANET COLORS Tar-Victoria WAVEGLIDER.NET DAR 1-21-27 PURPLE CODISTO SEAMASTER HOUR PLANET Barvictor W WAVE WEED CONTROL SKEET CODIFLASH PNO PLANETOUT JAVTRADER Sweet-N-Sterile CODIDIXAL PUREST ON THE PLANET WATERWEAR SWEET-EEZ CODIFLORUM CL MISS NUDE PLANET EARTH HEAT WAVE PADDLE BALL DEAR PURPLE CODIOAMLO SNOW TRAIN TO JASPER NWA 256 RIDERS SUITO KYARORIN SUITO HATO PAPURU CODIVISUAL SNOWBALL THE DANCING COCKATOO Summer Wave Violet JACK OFHEARTS CODIAGRO THE JELLY BEAN PLANET COOL WAVE GOLDEN YELLOW Karolina Codisk SONGPLANET.COM EXTREME WAVE FRUIT ROLLS Sweetcorn Honey Bantam 83 Gun Codiap Prunus persica Snow Lady Rose SUMMER WAVE PALE LILAC Hurt Codigo SNOW LAND TALL BEAUTY DOUBLE WAVE MISTY LILAC Holland Purple Codiway SNOW DELIGHT (OZWHITEDELIGHTTHREE) WAVERS Charm Purple Codibook SNOSWEET Waverly Calodine Codinan SNOWBALL, PALL DI NEEVE DOUBLE WAVE BLUE VEIN Caolina Codileg SNOWCOURT SHIRASAGI COOL WAVE PURPLE Impact-Purple Codicap SNOW SHOWER WHITE GEM COOL WAVE FROST Heartbeat Coditop SNOW CAP LOVE SONG WONDERITER Heartthrob Codibag ENERGY STAR GREEN PLANET COOL WAVE YELLOW Heartfelt Codiflu Super SnowBall UG SUMMER WAVE BOUQUET BLUE Bee Purple Codiwer Deksnow Flake BICOLOR NA PURPLE MOMOCHAN Codisun DEKSNOWPEAK DW AG PURPLE 2 (LILAC BEAUTY) Codimel SENHEART SUN COLOR Codilux Mefisto Purple Codibel CHIHAYA PURPLE Codipad SECRET PURPLE Codiplus IT PURPLE Codiblum REDHEART Codimono LADY PURPLE Codiblim FISTANEON (TANGO NEON PURPLE) Codiapea Jewel Purple Codiflex GARDEN VENUS PURPLE Codiboum DAIICHI BLUETTE FRESH PURPLE RY Codimpca TEMARI PURPLE KORISULAS Hana Purple Codiese PETINA PURPLE CODIAPE Burbanks Late Hearthoney Codirush Dekmacaron Purple Codix Supertunie Dark Purple Coditank Fort Purple Vein Codibird SPLASH PURPLE Codigreen MOHAWK (PURPLE PIXIE) Codirect PLAGU PURPLE Codipack Redayla purple Codifert FURORETTO PURPLE Codilive Dantoheart Codimust Heartbreaker CODIAWIM Ovation Purple Codianki Deksambupurple Coditour Vamp Time Purple Codisur Eleven Purple Codilav NAGANO PURPLE Codireal Codispot Codilio Codivox CL Coditoul Codiflo Codikart Codilate Codisurf CODIMARK CODIFLOU Codikorn Codival CODIARED Codimail Codiusre Codipro Codigrain Codirap Codiroc

[End of Annex IV and of document]