Submission Data for 2020-2021 CORE conference Ranking process Privacy Enhancing Technologies Symposium (was International Workshop of Privacy Enhancing Technologies)

Shaanan Cohney, Matthew Wright, Aaron Johnson, Veelasha Moonsamy

Conference Details

Conference

Title: Privacy Enhancing Technologies Symposium (was International Workshop of Privacy Enhancing Technologies) Acronym : PETS Rank: B

Requested Rank

Rank: A

Recent Years

Proceedings Publishing Style

Proceedings Publishing: journal Link to most recent proceedings: https://dblp.org/db/journals/popets/popets2020.html Further details: PETS papers are published in the journal Proceedings on Privacy Enhancing Technologies (PoPETs). PoPETs is an open-access journal published by Sciendo, part of the De Gruyter publishing house. PoPETs has four issues per year, and all papers that appear in PoPETs are full papers and are presented at the PETS conference. PoPETs builds on the scholarly tradition initiated by PETS in July 2000. The membership of the Editorial Board and Program Committee, as well as the high-quality publications, make PoPETs a premier venue for scholarship in the area of privacy and technology. Regarding Google Scholar Metrics, PoPETs is listed. However, the PoPETs journal only started in 2015, and Google Scholar Metrics doesn’t include the 2000âĂŞ2014 PETS proceedings published in Springer LNCS. Therefore, rankings are inaccurate that use metrics dependings on papers published before 2015 (e.g. h5-index).

Most Recent Years

Most Recent Year

Year: 2019 URL: https://petsymposium.org/cfp19.php Location: Stockholm, Sweden Papers submitted: 300 Papers published: 67 Acceptance rate: 22 Source for numbers: https://petsymposium.org/acceptance-rates.php General Chairs Name: Panos Papadimitratos Affiliation: KTH Gender: M H Index: 52 GScholar url: https://scholar.google.ca/citations?hl=en&user=Iv2wBQ8AAAAJ DBLP url: Name: Simone Fischer-HÃijbner Affiliation: Karlstad University, Sweden Gender: F H Index: 22 GScholar url: DBLP url: https://dblp.org/pid/f/SimoneFischerHubner.html

1 Program Chairs

Name: Carmela Tronosco Affiliation: EPFL Gender: F H Index: 27 GScholar url: https://scholar.google.ca/citations?user=sMkt3SgAAAAJ&hl=en&oi=ao DBLP url: https://dblp.org/pid/01/4825.html Name: Kostas Chatzikokolakis Affiliation: University of Athens Gender: M H Index: 23 GScholar url: https://scholar.google.com/citations?user=0XpXCu8AAAAJ&hl=en&oi=sra DBLP url: https://dblp.org/pid/32/858.html

Second Most Recent Year

Year: 2018 URL: https://petsymposium.org/cfp18.php Location: Barcelona, Spain Papers submitted: 229 Papers published: 36 Acceptance rate: 16 Source for numbers: https://petsymposium.org/acceptance-rates.php

General Chairs Name: Gemma GaldÃşn Clavell Affiliation: Eticas Gender: F H Index: 10 GScholar url: https://scholar.google.ca/citations?user=n9ALpfAAAAAJ&hl=en&oi=ao DBLP url: https://dblp.org/pid/130/9216.html

Program Chairs

Name: Damon McCoy Affiliation: NYC Gender: M H Index: 40 GScholar url: https://scholar.google.ca/citations?user=pT8-2f0AAAAJ&hl=en&oi=ao DBLP url: Name: Rachel Greenstadt Affiliation: NYU Gender: M H Index: 30 GScholar url: https://scholar.google.ca/citations?hl=en&user=FsbND-sAAAAJ DBLP url: https://dblp.org/pid/93/655.html Name: Carmela Tronosco Affiliation: EPFL Gender: F H Index: 27 GScholar url: https://scholar.google.ca/citations?user=sMkt3SgAAAAJ&hl=en&oi=ao DBLP url: https://dblp.org/pid/01/4825.html

Third Most Recent Year

Year: 2017 URL: https://petsymposium.org/cfp17.php Location: Minneapolis Papers submitted: 229 Papers published: 52 Acceptance rate: 23 Source for numbers: https://petsymposium.org/acceptance-rates.php

General Chairs

2 Name: Nick Hopper Affiliation: University of Minnesota Gender: M H Index: 38 GScholar url: https://scholar.google.ca/citations?user=4e2pnKYAAAAJ&hl=en&oi=sra DBLP url:

Program Chairs

Name: Rachel Greenstadt Affiliation: NYU Gender: F H Index: 30 GScholar url: https://scholar.google.ca/citations?hl=en&user=FsbND-sAAAAJ DBLP url: https://dblp.org/pid/93/655.html Name: Claudia Diaz Affiliation: KU Leuven Gender: F H Index: 34 GScholar url: https://scholar.google.com/citations?user=AUGbCSkAAAAJ&hl=en&oi=ao DBLP url: https://dblp.org/pid/d/ClaudiaDiaz.html

Policies

Chair Selection: ”The PET Board is responsible for guiding PETS, including PoPETs, by selecting each year’s General Chair and the Program Co-Chairs (who also serve as the PoPETs Co-Editors-in-Chief), as well as overseeing the operations of both the symposium and the journal. The Co-Editors-in-Chief have the primary responsibility for their issues of PoPETs and the program of PETS.” Policy name: Code of Conduct Policy url: https://petsymposium.org/code-of-conduct.php Policy name: Review Policy Policy url: https://petsymposium.org/reviews.php#guidelines

(Senior) Program Committee

Link to (s)pc: https://petsymposium.org/cfp20.php File: http://portal.core.edu.au/core/media/conf_submissions_spc_file/popetspc H-index plot: http://portal.core.edu.au/core/media/conf_submissions_hindex_plots/hindex_buckets_1035.png Information Contained within this graph is derived using the Elsevier Scopus Database 2021.

3 Data and Metrics

Google Scholar Metrics

Sub-category url: https://scholar.google.com/citations?view_op=top_venues&hl=en&vq=eng_computersecuritycryptography Position in sub-category: 15 Image of top 20: http://portal.core.edu.au/core/media/changes_h5/higherrank1035_gscholar_minh5.png

4 h5-index for this conference: 35

ACM Metrics

Not Sponsored by ACM

Aminer Rank

Not Listed in Aminer

Other Rankings

URL: http://jianying.space/conference-ranking.html Description: Quantitative ranking of academic security conferences based on ”Conference impact factor” Coheres closely with community expectations and matches CORE rankings for most conferences, as evidenced by the significant number of top people who contributed to the ranking system. Rank: 8 Conferences in area: IEEE S&P CCS USENIX PETS ESORICS SOUPS

Top People Publishing Here name: Jean-Pierre Hubaux justification: Jean-Pierre Hubaux is a top researcher in wireless security and data privacy, with over 41, 000 citations. He has won an Distinguished Paper Award (2018) and Distinguished Student Paper Award (2015) from the IEEE Symposium on Security and Privacy. He is an IEEE and ACM Fellow. Paper counts: Most Recent: Second most recent: Third most recent: Fourth most recent: Fifth most recent: 1 2 0 2 1 Attendance: SOMETIMES name: justification: Ian Goldberg is a top researcher in and . He was awarded the USENIX Security Test of Time Award (2019), the Award for Outstanding Research in Privacy Enhancing Technologies (2018), and he won the EFF Pioneer Award (2011). He is an ACM Distinguished Member. Paper counts: Most Recent: Second most recent: Third most recent: Fourth most recent: Fifth most recent: 2 1 3 0 4 Attendance: ALWAYS

5 name: Tadayoshi Kohno justification: Tadayoshi Kohno is a well-known researcher in security and privacy, with over 19, 000 citations. He is the recipient of a Sloan Research Fellowship, a U.S. National Science Foundation CAREER Award, and a Technology Review TR-35 Young Innovator Award. Kohno is also a member of the National Academies Forum on Cyber Resilience, the IEEE Center for Secure Design, and the USENIX Security Steering Committee. Paper counts: Most Recent: Second most recent: Third most recent: Fourth most recent: Fifth most recent: 2 0 1 1 1 Attendance: OCCASIONALLY name: Bryan Ford justification: Bryan Ford is a top researcher in distributed systems. He won the ACM CCS Test of Time Award (2020), the IRTF Applied Networking Prize (2020), the IEEE S&P Distinguished Paper Award (2018), and an NSF CAREER Award. He served as Program Chair of USENIX ATC 2017 and is a member of the IETF and IRTF security and cryptography working groups. Paper counts: Most Recent: Second most recent: Third most recent: Fourth most recent: Fifth most recent: 1 2 0 1 1 Attendance: SOMETIMES name: N. Asokan justification: N. Asokan is a top scholar in system security, with over 14, 000 citations. He is an ACM Fellow, and ACM Distinguished Member, an IEEE Fellow. In 2018, he won the ACM SIGSAC Outstanding Innovation Award. He has served as a member of the steering committee of the ACM Wireless Security conference, as an associate editor-in-chief of IEEE Security & Privacy Magazine, and as an associate editor of ACM Transactions on Information and Systems Security. Paper counts: Most Recent: Second most recent: Third most recent: Fourth most recent: Fifth most recent: 2 1 1 1 0 Attendance: OCCASIONALLY name: Ahmad-Reza Sadeghi justification: Ahmad-Reza Sadeghi is a top researcher in computer security, with major contributions to mobile security, hardware-based security, and applied cryptography. He has over 22, 000 citations. He was Editor-In-Chief of IEEE Security and Privacy Magazine, and he served 5 years on the editorial board of the ACM Transactions on Information and System Security. In 2018 he received the ACM SIGSAC Outstanding Contributions Award. Paper counts: Most Recent: Second most recent: Third most recent: Fourth most recent: Fifth most recent: 0 0 0 2 1 Attendance: OFTEN name: Nick Feamster justification: Nick Feamster is a top researcher in networking and security, with over 21, 000 citations. He received the Presidential Early Career Award for Scientists and Engineers (PECASE) for his contributions to cybersecurity, a Sloan Research Fellowship, the NSF CAREER award, the IRTF Applied Networking Research Prize, and the USENIX Test of Time Award. He is an ACM Fellow. Paper counts: Most Recent: Second most recent: Third most recent: Fourth most recent: Fifth most recent: 0 2 0 1 None Attendance: SOMETIMES name: Vern Paxson justification: Vern Paxson is a leader of the Internet measurement community, with over 64, 000 citations. He has won the IEEE S&P Test of Time Award (2020), the Internet Defense Prize (2017), the IEEE Internet Award (2015), the SIGCOMM Award (2011), the ACM Grace Murray Hopper Award (2007), and the SIGCOMM Test of Time Award (2006). He served as Chair of the Internet Research Task Force (2001âĂŞ2005) and was a co-founder of the Internet Measurement Conference. He is an ACM Fellow. Paper counts: Most Recent: Second most recent: Third most recent: Fourth most recent: Fifth most recent: 0 0 0 1 1 Attendance: OCCASIONALLY name: Kang G. Shin justification: Kang G. Shin is a leading researcher in networking and embedded systems, with over 52, 000 citations. He has received numerous awards, including 2019 Caspar Bowden Award for Outstanding Research in Privacy Enhancing Technologies. He is an ACM Fellow, an IEEE Fellow, and an overseas member of the Korean Academy of Engineering. He served as Editor of IEEE Trans. on Parallel and Distributed Computing, and he served as Area Editor of International Journal of Time-Critical Computing Systems, Computer Networks, and ACM Transactions on Embedded Systems. Paper counts: Most Recent: Second most recent: Third most recent: Fourth most recent: Fifth most recent: 1 0 0 0 1 Attendance: OCCASIONALLY name: David Wagner justification: David Wagner is a leading researcher in cryptography and security, with over 57, 000 citations. He has won the IEEE S&P Test of Time Award (2020), the USENIX Test of Time Award (2019), Internet Defense Prize (2017), the ACM SIGSAC Outstanding

6 Innovation Award (2016), a Sloan Fellowship (2003), an NSF Career Award (2001), and an ACM Doctoral Dissertation Award (2001). Paper counts: Most Recent: Second most recent: Third most recent: Fourth most recent: Fifth most recent: 0 1 0 1 0 Attendance: OCCASIONALLY

Where People Publish

Top (Senior) Program Committee Members

Generated Report Name: conf submissions top spc/higherrank1035 top spc.csv WPP Report: http://portal.core.edu.au/core/media/conf_rank_report/higherrank1035_spc_report.txt Graphs: http://portal.core.edu.au/core/media/conf_rank_graphs/higherrank1035_spc_graph.png

Journal WPP Report: http://portal.core.edu.au/core/media/conf_rank_journal_report/higherrank1035_spc_jnl_report.txt

Reference item: \\ 2. PoPETs (popets) ______

This journal was published at 85 times by 44 of 78 experts in the last 13 years.

The experts that publish at this journal are: Pedro Moreno-Sanchez(2), Ivan Martinovic(1), Sbastien Gambs(1), Claudio Orlandi(1), Serge Egelman(3), Apu Kapadia(7), Alan Mislove(1), Alptekin Kp(1), William Aiello(1), Rob Jansen(1), Wouter Lueks(1), Cecylia Bocovich(1), Catuscia Palamidessi(2), Philipp Winter(1), Jens Grossklags(1), Kvin Huguenin(4), Takao Murakami(2), Arvind Narayanan(4), Reza Shokri(1), Paul Syverson(2), Lujo Bauer(1), Sarah Meiklejohn(1), Ashwin Machanavajjhala(1), Fabian Prasser(1), Aniket Kate(3), Bogdan Carbunar(2), Nick Sullivan(1), Hassan Takabi(1), Nikita Borisov(3), Joel Reardon(1), Prateek Mittal(7), Markulf Kohlweiss(1), Melek nen(1), Amir Houmansadr(2), Charalampos Papamanthou(1), Florian Kerschbaum(1), Franziska Roesner(1), Rachel Greenstadt(11), Cristina Onete(2), Rinku Dewri(2), Zubair Shafiq(4), Phillip Rogaway(1), Ahmad-Reza Sadeghi(3), Rebekah Overdorf(1)

Top People Report

Method of selection: We took the top-20 people from Academic https://academic.microsoft.com/home in ”Internet Privacy” Keyword: Internet Privacy

7 name h-index gscholar url Lorrie Faith Cranor 95 https://scholar.google.com/citations?user=kIUqgbcAAAAJ Alessandro Acquisti 68 https://scholar.google.com/citations?user=2XCryp4AAAAJ Serge Egelman 38 https://scholar.google.com/citations?hl=en&user=WN9t4n0AAAAJ Jason Hong 72 https://scholar.google.com/citations?hl=en&user=MoFbcc0AAAAJ Elisa Bertino 100 https://scholar.google.com/citations?hl=en&user=EfuT9RoAAAAJ Norman Sadeh 69 https://scholar.google.com/citations?hl=en&user=X57uzqcAAAAJ Robert E. Kraut 110 https://scholar.google.com/citations?hl=en&user=HKGYvu4AAAAJ Patrick Gage Kelley 32 https://scholar.google.com/citations?hl=en&user=4_fN00YAAAAJ Huan Liu 110 https://scholar.google.com/citations?hl=en&user=Dzf46C8AAAAJ Alfred Kobsa 54 https://scholar.google.com/citations?hl=en&user=0nBysEcAAAAJ Heng Xu 40 https://scholar.google.com/citations?hl=en&user=8IAhRTYAAAAJ Steven Furnell 59 https://scholar.google.com/citations?user=Wp9EpxAAAAAJ&hl=en&oi=ao Dimitris Gritzalis 52 https://scholar.google.com/citations?user=5hIalXgAAAAJ&hl=en&oi=ao Apu Kapadia 37 https://scholar.google.com/citations?user=r42-hFIAAAAJ&hl=en Siani Pearson 38 https://scholar.google.com/citations?hl=en&user=yeCwF3oAAAAJ Vern Paxson 100 https://scholar.google.com/citations?user=HvwPRJ0AAAAJ&hl=en Sara Kiesler 102 https://scholar.google.com/citations?hl=en&user=8Qu_gAMAAAAJ Christopher Kruegel 104 https://scholar.google.com/citations?user=f0NoTC0AAAAJ&hl=en Sushil Jajodia 107 https://scholar.google.com/citations?user=lOZ1vHIAAAAJ&hl=en&oi=ao David Wagner 93 https://scholar.google.com/citations?user=67kghxAAAAAJ&hl=en&oi=ao

Reference item: \\ 2. PoPETs (popets) ______

This journal was published at 16 times by 5 of 16 experts in the last 5 years.

The experts that publish at this journal are: Apu Kapadia(7), Vern Paxson(3), Alfred Kobsa(1), Serge Egelman(3), Christopher Kruegel(2) WPP Report: http://portal.core.edu.au/core/media/conf_rank_report/higherrank1035_top_people_report.txt Graphs: http://portal.core.edu.au/core/media/conf_rank_graphs/higherrank1035_top_people_graph.jpg

Other Information

Comparator Comparison

Comparator

International Conference on Trust, Security and Privacy in Computing and Communications

Explanation as to why conference is superior to comparator: – Google scholar ranking top-20 in Security for PETS is 15, while TrustCom is unranked – Microsoft Academic’s ranking put PETS at #32 in prestige, while TrustCom is #69 – Jianying Zhao uses a quantitative ranking of security and cryptography conferences based on a

8 combination of acceptance rate, attendance per paper, and citation rate: http://jianying.space/conference-ranking.html. PETS is #8, TrustCom in unranked – PETS’s average acceptances rate is 21.5% 2011âĂŞ2020, more selective than TrustCom at 28.67%. Link to comparator report: http://portal.core.edu.au/core/media/conference_submission_2020/Data_Comparator_for_1035_228.pdf

Comparator

European Symposium On Research In Computer Security

Explanation as to why conference is superior to comparator: – Google scholar ranking top-20 in Security for is PETS 15, while ESORICS is 18. – Google scholar h5-index and h5-median are 35 and 55 for PETS, which are higher than 34 and 43 for ESORICS – Microsoft Academic’s ranking put PETS at #32 in prestige, while ESORICS is #39 – Jianying Zhao uses a quantitative ranking of security and cryptography conferences based on a combination of acceptance rate, attendance per paper, and citation rate: http://jianying.space/conference-ranking.html. PETS is #8, ESORICS is #12 – Notably, PETS has a much better rate of attendance per paper than ESORICS with roughly the same overall amount of attendance – PETS’s average acceptances rate is 21.5% 2011âĂŞ2020, comparable to ESORICS at 19.9% Link to comparator report: http://portal.core.edu.au/core/media/conference_submission_2020/Data_Comparator_for_1035_231.pdf

Other Relvant Info

Other relevant information: All statistics are computed starting no earlier than 2015, because PETS was published in a different format before 2015. PETS before 2015 was published by Springer, and starting in 2015 changed to a quarterly publishing model published by De Gruyter. This issue results in misleading numbers for PETS as the journal and conference tools produce results that include a period for which data is missing for PETS, resulting in artificially low rankings. As it is published as a journal, the submission does include graphs that were lacking from the conference WPP tools. The PET Award is awarded by PETS Advisory Board. This is a high-profile award and is presented at the PETS conference. The award includes as winners top researchers in the area of privacy ( https://petsymposium.org/award/winners.php)

Attachments

N/A

Proposers

First name: Shaanan Last name: Cohney Affiliation: University of Melbourne Email: [email protected]

First name: Matthew Last name: Wright Affiliation: Rochester Institute of Technology Email: [email protected]

First name: Aaron Last name: Johnson Affiliation: US Naval Research Lab Email: [email protected]

First name: Veelasha Last name: Moonsamy Affiliation: Ruhr University Bochum Email: [email protected]

Submitted By

Name: Cohney Shaanan Email: [email protected]

9