Professional Skills in Computer Science Topics Why Do We Cite the Work of Others?

Referencing Introduction General rules Vocabulary

Citing/ Citation Formally recognising, within your text, the sources from which you Professional Skills in Computer Science have obtained information Lecture 15: Bibliographies and Referencing (1) Reference A detailed description of a source from which you have obtained Ullrich Hustadt information Quotation Department of Computer Science A passage or words quoted within your text, School of Electrical Engineering, Electronics, and Computer Science University of Liverpool supported with both a citation and a reference to its source List of references List of all sources which are cited in the body of your work Bibliography List of all sources which have been consulted in preparation of your work

Ullrich Hustadt Professional Skills in Computer Science 1 Ullrich Hustadt Professional Skills in Computer Science 5

Referencing Introduction General rules Referencing Introduction General rules Topics The culture of citing

How many entries does the bibliography of the following textbooks contain? 1 Referencing W. Hughes, J. Lavery, and K. Doran: • Introduction Critical Thinking: An Introduction to the Basic Skills General rules (6th revised edition). Broadview Press, 2010. Today’s Questions: none 1 Why do we cite the work of others? R. Morelli and R. Walde: 2 When do we need to cite? • Java, Java, Java: Object-Oriented Problem Solving (3rd edition). When don’t we need to cite? Pearson, 2006. none R. Elmasri and S. Navathe: Fundamentals of Database Systems Relevant learning outcome: • (6th Edition). 1 To eﬀectively communicate in writing and orally Addison-Wesley, 2010. tons

Ullrich Hustadt Professional Skills in Computer Science 2 Ullrich Hustadt Professional Skills in Computer Science 6

Referencing Introduction General rules Referencing Introduction General rules Why do we cite the work of others? The culture of citing

We need sources, including the work of others, to acquire knowledge Fiction writing • • But why do we cite the work of others? There might be sources for your work, but these are never acknowledged • 1 To acknowledge the contribution of others Journalism • 2 To enable the reader to trace your sources easily and lead her/him to There must be sources for your work, but these are rarely acknowledged further information (sometimes for a good reason, often for no reason)

3 To demonstrate the body of knowledge on which our own work is based Exceptions: – Quotation of something said in public 4 To distinguish your own contribution from that of others – Reports (government, research, ‘think tank’) 5 To provide evidence, support and credibility for your arguments But acknowledgements are never in a format considered acceptable in academia We do NOT cite to indicate that we have copied text from another source! That’s plagiarism! Example: Guardian Online http://www.theguardian.com/uk-news/2013/oct/27/hs2-weekend-rail- closures-cost-backbench-mps

Ullrich Hustadt Professional Skills in Computer Science 3 Ullrich Hustadt Professional Skills in Computer Science 7

Referencing Introduction General rules Referencing Introduction General rules Plagiarism The culture of citing

Academic writing According to the University’s definition, plagiarism is: • All sources that make a contribution to your work must be acknowledged the verbatim (word for word) copying of another’s work without • appropriate and correctly presented acknowledgement; But practice varies: the close paraphrasing of another’s work by simply changing a few words Pure Mathematics • • or altering the order of presentation, without appropriate and correctly – Important concepts and results are given specific names, presented acknowledgement; often the name of the first person to introduce the concept/result, often these concepts/results are considered common knowledge unacknowledged quotation of phrases from another’s work; • – A lot of concepts have a fixed definition, results have a specific wording the deliberate and detailed presentation of another’s concept as one’s • definitions and results are stated or used without indication of a source own. ; verbatim copying and close paraphrasing of definitions and results Copying of another’s work, then adding a reference to that work, ; is standard (but not that of proofs!) is NOT considered an ‘appropriate and correctly presented Philosophy • acknowledgement’ – A lot of quotations, meticulously indicated as such Verbatim copying is only allowed in the context of proper quotation – A lot of discussion/argumentation with reference to previous work extensive and precise referencing ; Ullrich Hustadt Professional Skills in Computer Science 4 Ullrich Hustadt Professional Skills in Computer Science 8 Referencing Introduction General rules Citing: Rules of Thumb

If you use words or ideas from any document/medium, • even produced by yourself, then the source must be cited If you gain words or ideas through conversation, written or spoken, • then the source must be cited If you use the exact words/phrase from any document, medium or • conversation, it must not only be cited but also indicated as quotation If you reproduce audio-visual materials (with permission), • then the source must be cited

Ullrich Hustadt Professional Skills in Computer Science 9

Referencing Introduction General rules Citing: Rules of Thumb

No citation is required if you are writing about your own experiences, your own thoughts, • your own observations and insights, and your own conclusions that have not been published before writing about your own work and your own experiments • that have not been published before reusing your own audio-visual materials • using common knowledge or generally accepted facts • using facts (but not exact words) from recommended textbooks • Common Knowledge A piece of information is common knowledge if it stated as true in at least ﬁve credible sources (that are accessible to the wider public) and not contradicted in any credible source

Ullrich Hustadt Professional Skills in Computer Science 10

Referencing Introduction General rules The culture of citing: Summary

The extent to which sources are cited • The information provided for each source • The style in which citations and references are presented • depend on Type of writing • Fiction writing versus Journalism versus Academic writing Subject area • Pure Mathematics versus Philosophy versus Computer Science Publication • IJCAI versus Journal of Algorithms versus COMP110

Your citation and references are correct if and only if you adopt the correct type of writing for the correct subject area and the correct publication

Ullrich Hustadt Professional Skills in Computer Science 11

Referencing Introduction General rules Further reading

For more on the ethics of writing and plagiarism vs correct attribution • see J. Zobel: Writing for Computer Science. Springer, 2004. HCL 378.962.Z81 Chapter 13

Ullrich Hustadt Professional Skills in Computer Science 12 References Overview Types of work References

References must include the following information, Professional Skills in Computer Science with order and format depending on the chosen style: Lecture 16: Bibliographies and Referencing (2) Author(s) or editor(s) responsible for writing/editing the work cited • Title and subtitle of the work • Where the work can be obtained or found Ullrich Hustadt • Year the work was created, presented, and/or published • Department of Computer Science School of Electrical Engineering, Electronics, and Computer Science University of Liverpool What information is required about where the work can be obtained • depends on its type

How information is presented depends on the bibliography style • Next lecture ;

Ullrich Hustadt Professional Skills in Computer Science 1 Ullrich Hustadt Professional Skills in Computer Science 5

References References Overview Types of work Contents Why is a URL not enough?

Why is not enough to just give a URL for a source: • Example: http://www.sciencedirect.com/science/article/pii/ 1 References S0890540107001344 Overview Types of work 1 This URL might not be valid tomorrow 2 A reader knowledgeable in the subject area should be able to identify a source without the need to retrieve it 3 The reputation of a journal / conference is often taken as a proxy indicator of quality Relevant learning outcome: 1 To eﬀectively communicate in writing and orally URLs should only be given in addition to the required bibliographic • information, never instead of it

Ullrich Hustadt Professional Skills in Computer Science 2 Ullrich Hustadt Professional Skills in Computer Science 6

References References Overview Types of work The culture of citing Digital Object Identiﬁers

The extent to which sources are cited The Digital Object Identiﬁer (DOI) System is trying to solve the • • The information provided for each source problem of impermanence of URLs • a unique and permanent identiﬁer, DOI name is assigned to The style in which citations and references are presented • ; a source, the location is stored separately, and only accessible depend on via a DOI resolver, e.g. http://dx.doi.org Type of writing Example: • Fiction writing versus Journalism versus Academic writing The DOI name for the paper above is 10.1016/j.ic.2007.11.006 Subject area To access the paper use • http://dx.doi.org/10.1016/j.ic.2007.11.006 Pure Mathematics versus Philosophy versus Computer Science Publication DOIs are preferable over alternative URLs • • IJCAI versus Journal of Algorithms versus COMP110 But DOIs cannot solve the other two problems with URLs • 2 A reader knowledgeable in the subject area should be able to identify a Your citation and references are correct if and only if you adopt the correct source without the need to retrieve it type of writing for the correct subject area and the correct publication 3 The reputation of a journal / conference is often taken as a proxy indicator of quality

Ullrich Hustadt Professional Skills in Computer Science 3 Ullrich Hustadt Professional Skills in Computer Science 7

References Overview Types of work References Overview Types of work References Types of work and their references

References must include the following information, What information is required about where the work can be obtained • with order and format depending on the chosen style: depends on its type Author(s) or editor(s) responsible for writing/editing the work cited The information provided on where the work can be obtained • • Title and subtitle of the work indicates its type • Where the work can be obtained or found • Year the work was created, presented, and/or published Aiman Badri, Floriana Grasso and Paul Leng: Evaluation of Discussions in • Online Classrooms. Springer, 2003. is a book Author(s) and editor(s) are typically identiﬁed by name and stated on • the work itself Aiman Badri, Floriana Grasso and Paul Leng: Evaluation of Discussions in For corporate documents author information is often missing • Online Classrooms. In V. Palade, R. J. Howlett, and L. C. Jain, editors, The corporation is treated as author Knowledge-Based Intelligent Information and Engineering Systems, Title; and subtitle are typically stated on the work itself • Lecture Notes in Computer Science 2774, pp. 193–200. Springer, 2003. Year of publication is typically stated on the work itself is a conference paper • avoid work where this is not the case What; information is requiredUllrich Hustadt about whereProfessional the Skills work in Computer can Science be obtained 4 Ullrich Hustadt Professional Skills in Computer Science 8 • depends on its type References Overview Types of work References Overview Types of work Types of work and their references References: Types of work — Conference papers

What information is required about where the work can be obtained • depends on its type The information provided on where the work can be obtained Conference paper • Author(s) of the paper indicates its type • Title and subtitle of the paper • All information on the conference proceedings plus Aiman Badri, Floriana Grasso and Paul Leng: Evaluation of Discussions in • Page numbers of the paper Online Classrooms. • http://dx.doi.org/10.1007/978-3-540-45226-3_27. Example: 3-5 September 2003 (accessed 28 October 2013). Roger Antonsen: Uniform Variable Splitting. In D. A. Basin and is a web page M. Rusinowitch, editors, Automated Reasoning - Second International Joint Conference, IJCAR 2004, Cork, Ireland, July 4–8, 2004, Proceedings. Aiman Badri, Floriana Grasso and Paul Leng: Evaluation of Discussions in Lecture Notes in Computer Science 3097, p. 336–341. Springer, 2004. Online Classrooms. In V. Palade, R. J. Howlett, and L. C. Jain, editors, Knowledge-Based Intelligent Information and Engineering Systems, Lecture Notes in Computer Science 2774, pp. 193–200. Springer, 2003. is a conference paper Ullrich Hustadt Professional Skills in Computer Science 9 Ullrich Hustadt Professional Skills in Computer Science 13

References Overview Types of work References Overview Types of work References: Types of work — Books References: Types of work — Journal articles

Book Journal article Author(s) or editor(s) • Author(s) of the article Title and subtitle • • Title and subtitle of the article Edition, if not the ﬁrst, for example 2nd ed. • • Title of the journal Series and individual volume number (if any) • • Volume and part number Publisher • • Page numbers of article (Place of publication) • • Date, month or season of the year, if appropriate Year of publication • • Year of publication Examples: • A. A. Fraenkel, Y. Bar-Hillel, and A. Levy: Foundations of Set Theory, Note: Information on the publisher is typically not required 2nd revised edition. Studies in Logic and The Foundations of Examples: Mathematics 67. North-Holland, Amsterdam, 1973. R. MacGregor: Inside the LOOM description classiﬁer. SIGART A. Robinson and A. Voronkov, editors: Handbook of Automated Bulletin, 2(3):88–92, 1991. Reasoning. Elsevier, 2001.

Ullrich Hustadt Professional Skills in Computer Science 10 Ullrich Hustadt Professional Skills in Computer Science 14

References Overview Types of work References Overview Types of work References: Types of work — Book chapters References: Types of work — Newspaper articles

Chapter/section of a book with separate authors Newspaper / Magazine article Author(s) of the chapter/section • Author(s) of the article Title and subtitle of the chapter/section • • Title and subtitle of the article Author/editor of collected work • • Name of the newspaper / magazine Title and subtitle of collected work • • Volume and part number Chapter/section referred to • • Page numbers of article Page numbers of chapter/section referred to • • Date, month or season of the year, if appropriate Publisher • • Year of publication (Place of publication) • • Year of publication Information on the publisher is typically not required • • Example: If no author is indicated, leave this information out • W. Bibel and E. Eder: Methods and calculi for deduction. In when referring to the article use the name of the newspaper as author C. J. Hogger, D. M. Gabbay and J. A. Robinson, editors, Handbook of Examples: Logic in Artiﬁcial Intelligence and Logic Programming, Volume 1, A. Seager: Energy subsidy plan for homes runs out of cash. chapter 3, pages 67–182. Oxford University Press, 1993. The Guardian, 21 October 2006, p. 6. Ullrich Hustadt Professional Skills in Computer Science 11 Ullrich Hustadt Professional Skills in Computer Science 15

References Overview Types of work References Overview Types of work References: Types of work — Proceedings References: Types of work — Television programmes

Conference proceedings 1 One-oﬀ or regularly recurring TV programmes Editor(s) of proceedings (if information is available) • Report title, if applicable Name and number of conference • • Programme Title Location of conference (if appropriate) • • Name of channel Time of conference • • Title of published work; if diﬀerent from the name of the conference Date of transmission • • Series and individual volume number (if any) Time of transmission • • Publisher • Place of publication Examples: • Year of publication Local Storms Cause Power Outages. News at Ten, BBC One, • 2 November 2011, 22:00. Example: D. A. Basin and M. Rusinowitch, editors: Automated Reasoning - Tony Blair: “Iraq War”. Interview by Jeremy Paxman. Second International Joint Conference, IJCAR 2004, Cork, Ireland, Newsnight, BBC Two, Thursday, 6 February, 2003, 22:09 GMT July 4–8, 2004, Proceedings. Lecture Notes in Computer Science 3097. Steve Jobs: iChanged the World. Channel 4, 2 November 2011, 23:05. Springer, 2004.

Ullrich Hustadt Professional Skills in Computer Science 12 Ullrich Hustadt Professional Skills in Computer Science 16 References Overview Types of work References Overview Types of work References: Types of work — Television programmes References: Types of work — Legislation

2 Episode of a TV series Legislation Writer(s), if relevant Season and episode • • Title of the act Director(s), if relevant Name of channel • • • Year in which the act came into force Episode title Date of transmission • • • URL where the act can be found Producer(s), if relevant Time of transmission • • • Date on which you have accessed that URL Series title • • Examples: Example: Copyright, Designs and Patents Act 1988. Waldorf Stories. Mad Men. Season 4 Episode 6. http://www.legislation.gov.uk/ukpga/1988/48 BBC Four, 13 Oct 2010, 22:00. (accessed 17 December 2012). Brett Johnson and Matthew Weiner, writers, Scott Hornbacher, Human Rights Act 1998. director. Waldorf Stories. Matthew Weiner and Scott Hornbacher, http://www.legislation.gov.uk/ukpga/1998/42/contents producers: Mad Men. Season 4 Episode 6. (accessed 17 December 2012). BBC Four, 13 Oct 2010, 22:00.

Ullrich Hustadt Professional Skills in Computer Science 17 Ullrich Hustadt Professional Skills in Computer Science 21

References Overview Types of work References Overview Types of work References: Types of work — Theses References: Types of work — Court cases

Thesis and dissertation Court cases Author of the work Case name, typically given in the form claimant v defendant • • Title and subtitle of the work Year in which the case concluded • • Type of work Court • • Awarding institution including its address Case/judgement number or document details • • Year, possibly month, of publication URL where the document can be found • • Date on which you have accessed that URL Examples: • G. Rosu: Hidden Logic. PhD thesis, Department of Computer Science and Engineering, University of California, San Diego, CA, USA, August Examples: 2000. The Government of the United States of America v Richard O’Dwyer, R. A. van der Goot: Strategies for modal resolution. Master’s thesis, 2012. Westminster Magistrates’ Court. Faculty of Technical Mathematics and Informatics, Delft University of http://www.judiciary.gov.uk/wp-content/uploads/JCO/ Technology, The Netherlands, 1994. Documents/Judgments/us-v-odwyer-ruling.pdf (accessed 1 November 2014).

Ullrich Hustadt Professional Skills in Computer Science 18 Ullrich Hustadt Professional Skills in Computer Science 22

References Overview Types of work References Overview Types of work References: Types of work — Web pages Documents and pinpointing (1)

Web pages In your bibliography there must be a single reference • Author(s) of the web page(s) for every source/document that you need to cite • Title and subtitle • A document is a coherent text produced by a group of authors URL • • with its own title Date (possibly time) of last modification, if available • Examples: Date (possibly time) of access A book written together by three authors containing chapters with each • • chapter having its own title (but not author) is a single document Examples: A book written by three authors containing chapters with each chapter • The PHP Group: PHP: Hypertext preprocessor. having its own title but also its own author(s) is a collection of documents http://www.php.net/. A set of linked web pages written by the same author(s) on a particular topic • 28 October 2014 10:15 (accessed 1 November 2014 22:15). is a single document The International DOI Foundation: The Digital Object Identifier Examples of bibliography entries: System. http://www.doi.org/. 4. J. Zobel: Writing for Computer Science. Springer 2004. Last modification 15 October 2014. Accessed 1 November 2014. Zobel, J. (2004): Writing for Computer Science. Springer.

Ullrich Hustadt Professional Skills in Computer Science 19 Ullrich Hustadt Professional Skills in Computer Science 23

References Overview Types of work References Overview Types of work References: Types of work — Web pages Documents and pinpointing (2)

Why do we need both For longer documents it is the citation that needs to pinpoint the exact • • Date of last modification, if available location of the information that you are using • Date of access typically be stating a page number/range of page numbers • ; alternatively, by name/number of a theorem/definition To deal with the impermanence of the content of web pages! Examples:; • Note: If the web page does not itself indicate a date of last mod- According to Zobel, in diagrams units should be stated • ification, a web browser (e.g. Mozilla Firefox Page info) in labels [4, page 113]. → might be able to tell you According to Zobel (2004, page 113), in diagrams units should be stated in labels. Theorem 3.4 [3] shows that there are infinitely many prime numbers.

In Computer Science, conference papers and articles are typically • classiﬁed as short, books are classiﬁed as long

Ullrich Hustadt Professional Skills in Computer Science 20 Ullrich Hustadt Professional Skills in Computer Science 24 References Overview Types of work Types of work

A journal article accessible on the web is still a journal article • Bibliographic information needs to be presented as expected ; for a journal article The same applies to most other types of work: books, book chapters, • proceedings, conference papers, etc

However, you can of course also give the URL that you have used to • access a source You should then also indicate when you have accessed that ; source An article in the online version of a newspaper or magazine is both a • newspaper or magazine article and a web page Combine the required information ; Name of the newspaper often gets the suﬃx ’Online’, e.g. ; ‘The Guardian’ becomes ‘The Guardian Online’

Ullrich Hustadt Professional Skills in Computer Science 25 References Bibliography styles Reference manager More examples More Examples

Professional Skills in Computer Science Bad: Lecture 17: Bibliographies and Referencing (3) Marco Dorigo, Gianni Di Caro, Michael Samples, Ant Algorithms, third international workshop, Ant 2002, Brussels, Belgium, September 2002, Proceedings. Ullrich Hustadt

Department of Computer Science Good: School of Electrical Engineering, Electronics, and Computer Science Marco Dorigo, Gianni Di Caro, and Michael Samples, editors: Ant University of Liverpool Algorithms: Third International Workshop, ANTS 2002, Brussels, Belgium, September 12–14, 2002, Proceedings. Lecture Notes in Computer Science 2463. Springer, 2002.

Ullrich Hustadt Professional Skills in Computer Science 1 Ullrich Hustadt Professional Skills in Computer Science 5

References Bibliography styles Reference manager References Bibliography styles Reference manager More examples Contents More Examples

1 References More examples Bad: 2 Bibliography styles http://www.cut-the-knot.org/blue/Stern.shtml Ordinal number Author-Date Good: Abbreviation Alexander Bogomolny: Stern-Brocot Tree. http://www.cut-the-knot.org/blue/Stern.shtml. 3 Reference manager Last modiﬁcation 17 June 2000. Accessed 26 October 2013.

Relevant learning outcome: 1 To eﬀectively communicate in writing and orally

Ullrich Hustadt Professional Skills in Computer Science 2 Ullrich Hustadt Professional Skills in Computer Science 6

References Bibliography styles Reference manager More examples References Bibliography styles Reference manager Ordinal number Author-Date Abbreviation More Examples Bibliography styles

A bibliography style determines • how citations are presented • what information is in a citation ; what does a citation look like Bad: where is the citation placed how references are presented JAVA, JAVA, JAVA by Ralph Morelli • order of references within a bibliography Good: ; order of information within a reference Ralph Morelli: Java, Java, Java: Object-Oriented Problem Solving, 2nd fonts punctuation edition. Prentice Hall, 2003.

The three main classes of bibliography styles are: • 1 Ordinal Number 2 Author-Date 3 Abbreviation

Ullrich Hustadt Professional Skills in Computer Science 3 Ullrich Hustadt Professional Skills in Computer Science 7

References Bibliography styles Reference manager More examples References Bibliography styles Reference manager Ordinal number Author-Date Abbreviation More Examples Styles: Ordinal Number

Sources listed in the bibliography are sorted according to some ordering, • typically based on the authors’ names, and numbered consecutively Citations in the text are given as (lists of) numbers cross-referencing the • Bad: bibliography, enclosed in square brackets Marco Dorigo and Thomas Stutzle, Ant Colony Optimization.

Good: Example: Marco Dorigo and Thomas Stützle: Ant Colony Optimization. Key techniques for utilising temporal logic specifications have been investigated, Bradford Book, 2004. including verification via proof [3] and verification via model-checking [1,2]. Bibliography 1. E. Clarke, O. Grumberg, and D. A. Peled: Model Checking. MIT Press, 2000. 2. K. L. McMillan: Symbolic Model Checking. Kluwer, 1993. 3. M. Vardi and P. Wolper: Reasoning about infinite computations. Information and Computation 115:1–37, 1994.

Ullrich Hustadt Professional Skills in Computer Science 4 Ullrich Hustadt Professional Skills in Computer Science 8 References Bibliography styles Reference manager Ordinal number Author-Date Abbreviation References Bibliography styles Reference manager Ordinal number Author-Date Abbreviation Styles: Author-Date (1) Styles: Abbreviation (1)

Sources in the reference list are arranged alphabetically by Mix of ordinal number style and author-date style • • the authors’ surnames (phone book order); Sources in the bibliography are presented like in ordinal number style, • where there is more than one work by the same authors, they are arranged but instead of numbering them, each source is given a unique identiﬁer • by year of publication, starting with the earliest; based on authors’ names and year of publication, with additional letters where there is more than one work with the same authors and date, a letter to disambiguate duplicate abbreviations • is added to the year of publication to distinguish them Example: The year of publication typically immediately follows the list of authors • Bibliography [CGP00] E. Clarke, O. Grumberg, and D. A. Peled. Model Checking. Example: MIT Press, 2000. [vdG94] R. A. van der Goot. Strategies for modal resolution. Master’s thesis, Bibliography Delft University of Technology, The Netherlands, 1994. E. Clarke, O. Grumberg, and D. A. Peled (2000). Model Checking. MIT Press. [Wol96a] P. Wolper. Where is the Algorithmic Support? ACM Computing K. L. McMillan (1993). Symbolic Model Checking. Kluwer. Survey 28(4):58, 1996. M. Vardi and P. Wolper (1994). Reasoning about inﬁnite computations. [Wol96b] P. Wolper. The Meaning of “Formal”. ACM Computint Survey Information and Computation 115:1–37. 28(4):127, 1996.

Ullrich Hustadt Professional Skills in Computer Science 9 Ullrich Hustadt Professional Skills in Computer Science 13

References Bibliography styles Reference manager Ordinal number Author-Date Abbreviation References Bibliography styles Reference manager Ordinal number Author-Date Abbreviation Styles: Author-Date (1) Styles: Abbreviation (2)

Citations in the text are given as (lists of) abbreviations Sources in the reference list are arranged alphabetically by the authors’ • • cross-referencing the bibliography, again enclosed in square brackets names; where there is more than one work by the same authors, they are Examples: Key techniques for utilising temporal logic specifications have been investigated, arranged by year of publication, starting with the earliest; including verification via proof [VW94] and verification via model-checking where there is more than one work with the same authors and date, a [CGP00,McM93]. letter is added to the year of publication to distinguish them Recent work [Wol96a, Wol96b] stresses the importance of algorithmic support for Example: formal methods.

Bibliography Wolper in [Wol96a,Wol96b] stresses the importance of algorithmic support for formal methods. P. Wolper (1996a). Where is the Algorithmic Support? ACM Computing Surveys 28(4):58. The completion procedure may fail in general, but has been extended to a P. Wolper (1996b). The Meaning of “Formal”. ACM Computing Surveys refutationally complete theorem prover (cf. [Lan75,HR87,BDP89]). Completion 28(4):127. procedures for conditional equations have been described by Kounalis and Rusinowitch [KR88], and by Ganzinger [Gan87a,Gan87b].

Ullrich Hustadt Professional Skills in Computer Science 10 Ullrich Hustadt Professional Skills in Computer Science 14

References Bibliography styles Reference manager Ordinal number Author-Date Abbreviation References Bibliography styles Reference manager Styles: Author-Date (2) Organising references

There are myriads of styles for references and bibliographies A citation is given by the authors’ names and the date enclosed in • • You should maintain information on your sources in a ‘neutral’ format parentheses unless the authors’ names are part of the sentence • Ideally, you should use a tool which Example of quoting: • supports such a ‘neutral’ format The following is an extract from (Wolper, 1996a): • allows to add, delete, modify bibliographic information for documents • Consider, for instance, the issue of compositionality in proof allows to search for documents • systems for concurrency. I am not going to argue that interacts with your word processor/text editor compositionality is undesirable, but that achieving it without • generates a list of references in any desired format algorithmic support (in a broad sense) is easy and mostly useless. • Examples of such systems are Example of citing: • EndNote http://www.liv.ac.uk/library/research/endnote.html • While Wolper (1996a) states that he does not argue that compositionality Refworks http://www.liv.ac.uk/library/research/refworks.html in proof systems for concurrency is undesirable, he claims that achieving it • Zotero http://www.zotero.org/ without algorithmic support is mostly useless. • Zotero was covered in a COMP110 practical

Ullrich Hustadt Professional Skills in Computer Science 11 Ullrich Hustadt Professional Skills in Computer Science 15

References Bibliography styles Reference manager Ordinal number Author-Date Abbreviation References Bibliography styles Reference manager Styles: Author-Date (2) Organising references

A citation is given by the authors’ names and the date enclosed in Tools like Zotero help you to maintain a large set of • • parentheses unless the authors’ names are part of the sentence bibliographic information Examples: They ease the burden of referencing and generating lists of references Recent work (Wolper, 1996a, 1996b) stresses the importance of • algorithmic support for formal methods. according to a speciﬁc style

Wolper (1996a, 1996b) stresses the importance of algorithmic support for If no speciﬁc style is requested, then a providing all the necessary • formal methods. information about each of your sources in a consistent way is the most important aspect of a bibliography The completion procedure may fail in general, but has been extended to a refutationally complete theorem prover (cf. Lankford, 1975; Hsiang and Beware that the way you formulate sentences which include references • Rusinowitch, 1987; and Bachmair, Dershowitz and Plaisted, 1989). depends on the referencing style Completion procedures for conditional equations have been described by changing that style later is time-consuming and error-prone Kounalis and Rusinowitch (1988), and by Ganzinger (1987a,b). ;

Ullrich Hustadt Professional Skills in Computer Science 12 Ullrich Hustadt Professional Skills in Computer Science 16 References Bibliography styles Reference manager References Bibliography styles Reference manager Citing: Rules of Thumb (Zobel 2004) Citing (3)

If you discuss a paper in detail or note some particular contribution it A citation in ordinal-number style never starts a sentence • • makes, it mustbe cited and referenced Wrong: [9] Disaster rescue is a serious social issue. Claims, statements of fact, discussions of previous work shouldbe Correct: Disaster rescue is a serious social issue [9]. • supported by references, if not supported by your current work In most Computer Science publications a citation never comes after the • This does include references to your own work if previously published end of sentence except for quotations But: Do not cite to support common knowledge; Wrong: 2-on-2 teams of autonomous mobile robots play games in a do not end every sentence with a reference rectangular ﬁeld color-coded in shades of grey. [9] Attribute work correctly, in particular, when relying on secondary Correct: 2-on-2 teams of autonomous mobile robots play games in a • sources rectangular ﬁeld colour-coded in shades of gray [9]. Bad: According to Dawson (1981), stable graphs have been shown to In ordinal-number style a list of citations is a comma-separated list of • be closed numbers enclosed in one pair of square brackets Good: According to Kelly (1959; as quoted by Dawson, 1981), stable Wrong: The humanoid soccer robots are fully autonomous [5][9]. graphs are closed Correct: The humanoid soccer robots are fully autonomous [5,9].

Ullrich Hustadt Professional Skills in Computer Science 17 Ullrich Hustadt Professional Skills in Computer Science 21

References Bibliography styles Reference manager References Bibliography styles Reference manager Citing (1) Citing (4)

Place citations in sentences and paragraphs so that it is clear which A citation never occurs in a section heading • • material has come from which source or sources Wrong: Section 5. The History of RoboCup [9] Use signposting/transitions to indicate whether several sentences • Wrong: Section 5. The History of RoboCup (Henry 2006) contain material from the same source or from different sources If a whole paragraph is based on a single source or single list of sources, Beware of the differences between ordinal-number style and author-date • • introduce the sources early in the paragraph style do not simply add a list of sources at the end of the paragraph Wrong: [11,12] stresses the importance of algorithmic support for Example:; formal methods. Jones (1985) found that positioning influences ventilation. In his Correct: Wolper [11,12] stresses the importance of algorithmic support study of 20 cases, he used two methods to . . . . However, his findings for formal methods. were later contradicted by the work of Karcher (1987) and Atley Correct: Wolper (1996a, 1996b) stresses the importance of algorithmic (1989) who used much larger samples to demonstrate that . . . support for formal methods.

Ullrich Hustadt Professional Skills in Computer Science 18 Ullrich Hustadt Professional Skills in Computer Science 22

References Bibliography styles Reference manager References Bibliography styles Reference manager Citing (2) Citing (5)

With respect to placing a citation within a sentence, Examples of correct use of author-date style: this can either be done While Wolper (1996a) does not argue that compositionality in proof idea-focused: • systems for concurrency is undesirable, he claims that achieving it without Close to the idea, for example, at the end of the first sentence or algorithmic support is mostly useless. part of the sentence explaining the idea Recent work (Wolper, 1996a,b) stresses the importance of algorithmic Examples: support for formal methods. Key techniques for utilising temporal logic specifications have been Wolper (1996a,b) stresses the importance of algorithmic support for investigated, including verification via proof [1] and verification via formal methods. model-checking [2,3]. The completion procedure may fail in general, but has been extended to a In general, formal verification of software-based systems is an refutationally complete theorem prover (cf. Lankford, 1975; Hsiang and undecidable problem (Turing, 1936). Rusinowitch, 1987). author/source-focused: • Completion procedures for conditional equations have been described by Immediately after the names of the authors or mention of the source Kounalis and Rusinowitch (1988), and by Ganzinger (1987a,b).

Ullrich Hustadt Professional Skills in Computer Science 19 Ullrich Hustadt Professional Skills in Computer Science 23

References Bibliography styles Reference manager References Bibliography styles Reference manager Citing (2) Further reading

With respect to placing a citation within a sentence, For more on references and citations see • this can be done J. Zobel: idea-focused: • Writing for Computer Science. Close to the idea, for example, at the end of the ﬁrst sentence or Springer, 2004. part of the sentence explaining the idea HCL 378.962.Z81 author/source-focused: Chapter 2; see index for further information • Immediately after the names of the authors or mention of the source Examples: Wolper (1996a, 1996b) stresses the importance of algorithmic support for formal methods. Wolper [4,5] stresses the importance of algorithmic support for formal methods. Recent work [Wol96a, Wol96b] stresses the importance of algorithmic support for formal methods.

Ullrich Hustadt Professional Skills in Computer Science 20 Ullrich Hustadt Professional Skills in Computer Science 24 Quoting Quoting

Example taken from a student’s text: Professional Skills in Computer Science Such dangers are catered for by ensuring the closure of the function set. Koza (1992) states that: Lecture 18: Bibliographies and Referencing (4) The closure property requires that each of the functions in the function set be able to accept, as its arguments, Ullrich Hustadt any value and data type that may possibly be assumed by any terminal set. That is, each function in the function Department of Computer Science set should be well deﬁned and closed for any combination School of Electrical Engineering, Electronics, and Computer Science University of Liverpool of arguments that it may encounter. Without closure, many individuals could have their ﬁtness drastically lowered as a result of minor syntactic errors.

Direct quotation from Koza (1992); clearly indicated by separation and indentation; restricted to (less than) one paragraph; source cited

Ullrich Hustadt Professional Skills in Computer Science 1 Ullrich Hustadt Professional Skills in Computer Science 5

Quoting Quoting Contents Quoting

Examples taken from a student’s text: Bickle (1996) states that “[t]he superior method to obtain compact and accurate solutions is the method of adaptive parsimony pressure [. . . ]”. 1 Quoting Quotation clearly indicated by quotation marks; alterations indicated in square brackets; source cited Day (2005) reports that “GP shows great promise in creating Relevant learning outcome: robust classifiers for [Automatic Speaker Verification] purposes” where programs attempt to recognise the voice of a known 1 To effectively communicate in writing and orally individual.

Quotation clearly indicated by quotation marks; alterations indicated in square brackets; source cited

Ullrich Hustadt Professional Skills in Computer Science 2 Ullrich Hustadt Professional Skills in Computer Science 6

Quoting Quoting Citing versus Copying Quoting

Student’s text: Original text [19]: Examples taken from a student’s text: An example of the described system KNOWITALL is an autonomous More recently, in 1999, Tim Berners-Lee [3], father of the World is KNOWITALL [19]. It is an au- system that extracts facts, con- Wide Web (WWW) speaking of the WWW stated that he saw it as tonomous system that extracts facts, cepts, and relationships from the “an information space through which people can concepts, and relationships from the web. KNOWITALL is seeded with web. KNOWITALL [19] is seeded communicate; but communicate in a special way: an extensible ontology and a small with an extensible ontology and a communicate by sharing their knowledge in a pool. The small number of generic rule tem- number of generic rule templates idea was not that it should be a big browsing medium. plates from which it creates text ex- from which it creates text extrac- The idea was that everybody would be putting their ideas traction rules for each class and re- tion rules for each class and rela- in as well as taking them out.” lation in its ontology. The system tion in its ontology. The system relies on a domain- and language- relies on a domain- and language- A Wiki is in Ward Cunningham’s [43] original description: independent architecture to populate independent architecture to pop- the ontology with speciﬁc facts and ulate the ontology with speciﬁc “The simplest online database that could possibly work.” relations. facts and relations. Direct quotation indicated by separation, indentation, and quotation References are not meant to indicate copying! This is wrong! marks; source cited.

Ullrich Hustadt Professional Skills in Computer Science 3 Ullrich Hustadt Professional Skills in Computer Science 7

Quoting Quoting Citing versus Copying Quoting: Rules of Thumb

Original text [19]: Improved text: KNOWITALL is an autonomous sys- An example of the described system tem that extracts facts, concepts, is KNOWITALL [19]. Given an initial and relationships from the web. ontology and a small number of rule Avoid excessive quotation KNOWITALL is seeded with an ex- templates which do not depend on • tensible ontology and a small number the class and relationships in the on- Quotation is only appropriate of generic rule templates from which tology, KNOWITALL generates text • where you want to comment on the statements made by someone else, in it creates text extraction rules for extraction rules for each class and re- • each class and relation in its ontology. lationship in the ontology. These text particular, if your comments relate to the wording of the statement where the quote is of some historical signiﬁcance The system relies on a domain- and extraction rules are then applied to • language-independent architecture to texts found on the web. Rule applica- populate the ontology with speciﬁc tions populate the ontology with in- In all other cases, use your own words facts and relations. stances of the concepts and relation- • ships in the ontology. Still not great, but shows some understanding

Ullrich Hustadt Professional Skills in Computer Science 4 Ullrich Hustadt Professional Skills in Computer Science 8 Quoting Quoting Evidence and Support Evidence and Support

Example taken from a student’s text: As Lenat (1995) has noted in an earlier paper, Cyc is a brilliant system. Intelligent agents, autonomous or semi-autonomous systems • that take decisions and perform tasks in complex, dynamically Lenat (1995) demonstrates that Cyc is a brilliant system. • changing environments, revolutionized the ﬁeld of AI. Cyc is a brilliant system (Lenat 1995). • This is stating an opinion not a generally known and accepted fact In the sentences above, the author agrees with Lenat (1995) • As such it needs support which it currently lacks • Support could be provided by some statistical evidence or by a reference Lenat (1995) alleges that Cyc is a brilliant system. • • (Made-up) example of statistical evidence: Lenat (1995) claims that Cyc is a brilliant system. • • The concept of intelligent agents was ﬁrst introduced in 1983. In the sentences above, the author disagrees with Lenat (1995) By 2003, more than half of all papers published in the main forums of AI, referred to the concept or made use of intelligent Lenat (1995) states that Cyc is a brilliant system. • agents, and it has spawned a world wide industry worth 5 In the sentence above, the author is neutral with regard to the truth of the billion US$ [2]. statement ‘Cyc is a brilliant system’ where [2] is a citation for the source of these statistics. Ullrich Hustadt Professional Skills in Computer Science 9 Ullrich Hustadt Professional Skills in Computer Science 13

Quoting Quoting Evidence and Support Evidence and Support

Example taken from a student’s text: Example taken from a student’s text: To deal with information in the web environment what is The most popular ways to compress data are the Huffman needed is a logic that supports modes of reasoning which are coding and Shannon-Fano coding. approximate rather than exact. It is unclear on what basis compression methods are judged to be • ‘popular’ Again, this is stating an opinion not a generally known and accepted fact number of compressed files • • Support could be provided by an argument or by a reference number of users of compression software • • A reference could point to a scientific paper where this opinion is stated number of developers of compression software • • and argued for In each case, statistical evidence seems to be required, e.g. • An argument could be an example illustrating the advantage of In 2004, 60% of all compressed files were compressed using the • approximate over exact reasoning Huffman coding or Shannon-Fano coding [3]. If that example is taken from a source, then again that source needs to where [3] is a citation for the source of these statistics. referenced

Ullrich Hustadt Professional Skills in Computer Science 10 Ullrich Hustadt Professional Skills in Computer Science 14

Quoting Quoting Evidence and Support Plagiarism Detection

Example taken from a student’s text: To deal with information in the web environment what is needed is a logic that supports modes of reasoning which are All reports (and in later years your project reports and your • approximate rather than exact. dissertations) will be subject to a plagiarism check The Department uses Turnitin for this purpose Better formulation: Programs are subject to a similarity check It has been argued by Oberschlau [1] that to deal with • information in the web environment what is needed is a logic The Department uses a system called Moss for this purpose that supports modes of reasoning which are approximate rather than exact. Examples: COMP110 Assignment or COMP101 Assignment According to Oberschlau [1], to deal with information in the web environment what is needed is a logic that supports modes of reasoning which are approximate rather than exact.

Ullrich Hustadt Professional Skills in Computer Science 11 Ullrich Hustadt Professional Skills in Computer Science 15

Quoting Quoting Evidence and Support COMP110 Assignment 1: Recap

Example taken from a student’s text: Therefore, once our system is enhanced with our common Sources must be referenced as shown in Lecture 15 knowledge about things we know, [it] could be seen as an • intelligent entity. A brilliant example is the Cyc knowledge base. Citations and list of references must be given in ordinal-number style • as shown in Lectures 17 Citations must be given using square brackets and placed The phrase ‘brilliant example’ is ambiguous: • • as shown in Lectures 17 and 18 Cyc a system incorporating common knowledge and it is a good References must contain the information shown in Lecture 16 example of such a system. • References must be presented in the format shown in Lecture 17 • versus Entries in the list of references must be sorted alphabetically Cyc is a brilliant system incorporating common knowledge. •

Both readings require support, in particular, the second version •

Ullrich Hustadt Professional Skills in Computer Science 12 Ullrich Hustadt Professional Skills in Computer Science 16