En En Amendments

European Parliament 2019-2024

Committee on Legal Affairs

2020/2012(INL)

29.5.2020

AMENDMENTS 430 - 652

Draft report Ibán García Del Blanco (PE650.508v01-00)

Framework of ethical aspects of artificial intelligence, robotics and related technologies (2020/2012(INL))

AM\1206345EN.docx PE652.548v02-00

EN United in diversityEN AM_Com_NonLegReport

PE652.548v02-00 2/117 AM\1206345EN.docx EN Amendment 430 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – recital 25

Motion for a resolution Amendment

(25) Socially responsible artificial (25) Socially responsible artificial intelligence, robotics and related intelligence, robotics and related technologies, including the software, technologies, including the software, algorithms and data used or produced by algorithms and data used or produced by such technologies, can be defined as such technologies, can be defined as technologies which both safeguard and technologies which contribute to find promote a number of different aspects of solutions that safeguard and promote a society, most notably democracy, health number of different aspects of society, and economic prosperity, equality of most notably democracy, health and opportunity, workers’ and social rights, economic prosperity, equality of diverse and independent media and opportunity, workers’ and social rights, objective and freely available information, diverse and independent media and allowing for public debate, quality objective and freely available information, education, cultural and linguistic diversity, allowing for public debate, quality gender balance, digital literacy, innovation education, cultural and linguistic diversity, and creativity. They are also those that are gender balance, digital literacy, innovation developed, deployed and used having due and creativity. Nevertheless, those regard for their ultimate impact on the requirements shall be applicable only to physical and mental well-being of citizens. high-risk artificial intelligence, robotics and related technologies. They are also those that are developed, deployed and used having due regard for their ultimate impact on the physical and mental well- being of citizens.

Or. en

Amendment 431 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – recital 25

Motion for a resolution Amendment

AM\1206345EN.docx 3/117 PE652.548v02-00 EN such technologies, can be defined as to be used by such technologies, can be technologies which both safeguard and defined as technologies which both promote a number of different aspects of safeguard and promote a number of society, most notably democracy, health different aspects of society, most notably and economic prosperity, equality of democracy, health and economic opportunity, workers’ and social rights, prosperity, equality of opportunity, diverse and independent media and workers’ and social rights, diverse and objective and freely available information, independent media and objective and freely allowing for public debate, quality available information, allowing for public education, cultural and linguistic diversity, debate, quality education, cultural and gender balance, digital literacy, innovation linguistic diversity, gender balance, digital and creativity. They are also those that are literacy, innovation and creativity. They developed, deployed and used having due are also those that are developed, deployed regard for their ultimate impact on the and used having due regard for their physical and mental well-being of citizens. ultimate impact on the physical and mental well-being of citizens.

Or. en

Amendment 432 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – recital 26

Motion for a resolution Amendment

(26) These technologies should also be (26) The Union and its Member States developed, deployed and used with a view should mobilise their resources for the to supporting social inclusion, plurality, purpose of supporting and investing in solidarity, fairness, equality and such projects. cooperation and their potential in that context should be maximized and explored through research and innovation projects. The Union and its Member States should therefore mobilise their resources for the purpose of supporting and investing in such projects.

Or. en

Amendment 433 Geoffroy Didier, Andrzej Halicki, Axel Voss

PE652.548v02-00 4/117 AM\1206345EN.docx EN Motion for a resolution Annex I – part B – recital 26

Motion for a resolution Amendment

(26) These technologies should also be (26) These technologies can also be developed, deployed and used with a view developed, deployed and used with a view to supporting social inclusion, plurality, to supporting social inclusion, plurality, solidarity, fairness, equality and solidarity, fairness, equality and cooperation and their potential in that cooperation and their potential in that context should be maximized and explored context should be maximized and explored through research and innovation projects. through research and innovation projects. The Union and its Member States should The Union and its Member States should therefore mobilise their resources for the therefore mobilise their resources for the purpose of supporting and investing in purpose of supporting and investing in such projects. such projects.

Or. en

Amendment 434 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – recital 27

Motion for a resolution Amendment

(27) Projects relating to the potential of deleted artificial intelligence, robotics and related technologies to deal with the question of social well-being should be carried out on the basis of responsible research and innovation tools so as to guarantee the compliance with ethical principles of those projects from the outset.

Or. en

Amendment 435 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – recital 28

AM\1206345EN.docx 5/117 PE652.548v02-00 EN Motion for a resolution Amendment

(28) The development, deployment and (28) The development, deployment and use of artificial intelligence, robotics and use of artificial intelligence, robotics and related technologies, including the related technologies, including the software, algorithms and data used or software, algorithms and data produced or produced by such technologies, should take destined to be used by such technologies, into consideration their environmental should take into consideration their footprint and should not cause harm to the environmental footprint and should not environment during their lifecycle and cause harm to the environment during their across their entire supply chain. lifecycle and across their entire supply Accordingly, such technologies should be chain. Accordingly, such technologies developed, deployed and used in an should be developed, deployed and used in environmentally friendly manner that a manner that preserves the environment, supports the achievement of climate minimises and remedies their neutrality and circular economy goals. environmental footprint and contributes to the green transition, support the achievement of climate neutrality and circular economy goals.

Or. en

Amendment 436 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – recital 28

Motion for a resolution Amendment

(28) The development, deployment and (28) The development, deployment and use of artificial intelligence, robotics and use of high-risk artificial intelligence, related technologies, including the robotics and related technologies, including software, algorithms and data used or the software, algorithms and data used or produced by such technologies, should take produced by such technologies, should take into consideration their environmental into consideration their environmental footprint and should not cause harm to footprint. In line with the obligations laid the environment during their lifecycle and down in Union law, high-risk artificial across their entire supply chain. intelligence, robotics and related Accordingly, such technologies should be technologies, including the software, developed, deployed and used in an algorithms and data used or produced by environmentally friendly manner that such technologies should be developed, supports the achievement of climate deployed and used in an environmentally neutrality and circular economy goals. sustainable manner that supports the achievement of climate neutrality and

PE652.548v02-00 6/117 AM\1206345EN.docx EN circular economy goals.

Or. en

Amendment 437 Stéphane Séjourné, Karen Melchior, Liesje Schreinemacher, Adrián Vázquez Lázara

Motion for a resolution Annex I – part B – recital 28

Motion for a resolution Amendment

(28) The development, deployment and (28) Where applicable, the use of artificial intelligence, robotics and development, deployment and use of related technologies, including the artificial intelligence, robotics and related software, algorithms and data used or technologies, including the software, produced by such technologies, should take algorithms and data used or produced by into consideration their environmental such technologies, should take into footprint and should not cause harm to the consideration their environmental footprint environment during their lifecycle and and should not cause harm to the across their entire supply chain. environment during their lifecycle and Accordingly, such technologies should be across their entire supply chain. developed, deployed and used in an Accordingly, such technologies should be environmentally friendly manner that developed, deployed and used in an supports the achievement of climate environmentally friendly manner that neutrality and circular economy goals. supports the achievement of climate neutrality and circular economy goals.

Or. en

Amendment 438 Stéphane Séjourné, Liesje Schreinemacher, Adrián Vázquez Lázara

Motion for a resolution Annex I – part B – recital 29

Motion for a resolution Amendment

(29) For the purposes of this deleted Regulation, developers, deployers and users should be held responsible, to the extent of their involvement in the development, deployment or use of the artificial intelligence, robotics and related technologies concerned, for any harm

AM\1206345EN.docx 7/117 PE652.548v02-00 EN caused to the environment.

Or. en

Amendment 439 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – recital 29

Motion for a resolution Amendment

(29) For the purposes of this (29) Developers, deployers and users of Regulation, developers, deployers and high-risk artificial intelligence, robotics users should be held responsible, to the and related technologies, including the extent of their involvement in the software, algorithms and data used or development, deployment or use of the produced by such technologies, should be artificial intelligence, robotics and related held responsible, to the extent of their technologies concerned, for any harm involvement in the development, caused to the environment. deployment or use of the artificial intelligence, robotics and related technologies concerned, for any harm caused to the environment in accordance with the applicable environmental liability rules.

Or. en

Amendment 440 Stéphane Séjourné, Liesje Schreinemacher, Adrián Vázquez Lázara

Motion for a resolution Annex I – part B – recital 30

Motion for a resolution Amendment

PE652.548v02-00 8/117 AM\1206345EN.docx EN such harm, namely by respectively putting adequate measures in place during the development process and thoroughly respecting such measures during the deployment phase.

Or. en

Amendment 441 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – recital 30

Motion for a resolution Amendment

(30) In particular, the developers who deleted take decisions that determine and control the course or manner of the development of artificial intelligence, robotics and related technologies, as well the deployers who are involved in their deployment with an operating or managing function, should be generally considered responsible for avoiding the occurrence of such harm, namely by respectively putting adequate measures in place during the development process and thoroughly respecting such measures during the deployment phase.

Or. en

Amendment 442 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – recital 31

Motion for a resolution Amendment

AM\1206345EN.docx 9/117 PE652.548v02-00 EN waste production, diminishing the carbon law, such as reducing waste production, footprint, preventing climate change and diminishing the carbon footprint, avoiding environmental degradation, and preventing climate change and avoiding their potential in that context should be environmental degradation, and their maximized and explored through research potential in that context should be and innovation projects. The Union and the maximized and explored through research Member States should therefore mobilise and innovation projects. The Union and the their resources for the purpose of Member States should therefore mobilise supporting and investing in such projects. their resources for the purpose of supporting and investing in such projects.

Or. en

Amendment 443 Stéphane Séjourné, Karen Melchior, Liesje Schreinemacher, Adrián Vázquez Lázara

Motion for a resolution Annex I – part B – recital 31

Motion for a resolution Amendment

(31) These technologies should also be (31) Where applicable, these developed, deployed and used with a view technologies should also be developed, to supporting the achievement of deployed and used with a view to environmental goals such as reducing supporting the achievement of waste production, diminishing the carbon environmental goals such as reducing footprint, preventing climate change and waste production, diminishing the carbon avoiding environmental degradation, and footprint, preventing climate change and their potential in that context should be avoiding environmental degradation, and maximized and explored through research their potential in that context should be and innovation projects. The Union and the maximized and explored through research Member States should therefore mobilise and innovation projects. The Union and the their resources for the purpose of Member States should therefore mobilise supporting and investing in such projects. their resources for the purpose of supporting and investing in such projects.

Or. en

Amendment 444 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – recital 31

PE652.548v02-00 10/117 AM\1206345EN.docx EN Motion for a resolution Amendment

(31) These technologies should also be (31) These technologies should also be developed, deployed and used with a view developed, deployed and used with a view to supporting the achievement of to supporting the achievement of environmental goals such as reducing environmental goals such as ending waste waste production, diminishing the carbon production, diminishing the carbon footprint, preventing climate change and footprint, remedying climate change and avoiding environmental degradation, and preserving the environment, and their their potential in that context should be potential in that context should be maximized and explored through research maximized and explored through research and innovation projects. The Union and the and innovation projects. The Union and the Member States should therefore mobilise Member States should therefore mobilise their resources for the purpose of their resources for the purpose of supporting and investing in such projects. supporting and investing in such projects.

Or. en

Amendment 445 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – recital 33

Motion for a resolution Amendment

(33) Any artificial intelligence, robotics (33) Any artificial intelligence, robotics and related technologies, including and related technologies, including software, algorithms and data used or software, algorithms and data produced or produced by such technologies, developed, destined to be used by such technologies, deployed and used in the Union should developed, deployed and used in the Union fully respect Union citizens’ rights to should fully respect Union citizens’ rights privacy and protection of personal data. In to privacy and protection of personal data. particular, their development, deployment In particular, their development, and use should be in accordance with deployment and use should be in Regulation (EU) 2016/679 of the European accordance with Regulation (EU) 2016/679 Parliament and of the Council1 and of the European Parliament and of the Directive 2002/58/EC of the European Council1 and Directive 2002/58/EC of the Parliament and of the Council2 . European Parliament and of the Council2 . ______1 Regulation (EU) 2016/679 of the 1 Regulation (EU) 2016/679 of the European Parliament and of the Council of European Parliament and of the Council of 27 April 2016 on the protection of natural 27 April 2016 on the protection of natural persons with regard to the processing of persons with regard to the processing of personal data and on the free movement of personal data and on the free movement of

AM\1206345EN.docx 11/117 PE652.548v02-00 EN such data, and repealing Directive such data, and repealing Directive 95/46/EC (General Data Protection 95/46/EC (General Data Protection Regulation) (OJ L 119, 4.5.2016, p. 1). Regulation) (OJ L 119, 4.5.2016, p. 1). 2 Directive 2002/58/EC of the European 2 Directive 2002/58/EC of the European Parliament and of the Council of 12 July Parliament and of the Council of 12 July 2002 concerning the processing of personal 2002 concerning the processing of personal data and the protection of privacy in the data and the protection of privacy in the electronic communications sector electronic communications sector (Directive on privacy and electronic (Directive on privacy and electronic communications) (OJ L 201, 31.7.2002, p. communications) (OJ L 201, 31.7.2002, p. 37). 37).

Or. en

Amendment 446 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – recital 33

Motion for a resolution Amendment

(33) Any artificial intelligence, robotics (33) High-risk artificial intelligence, and related technologies, including robotics and related technologies, including software, algorithms and data used or software, algorithms and data used or produced by such technologies, developed, produced by such technologies, developed, deployed and used in the Union should deployed and used in the Union should fully respect Union citizens’ rights to fully respect Union citizens’ rights to privacy and protection of personal data. In privacy and protection of personal data. In particular, their development, deployment particular, their development, deployment and use should be in accordance with and use should be in accordance with Regulation (EU) 2016/679 of the European Regulation (EU) 2016/679 of the European Parliament and of the Council1 and Parliament and of the Council1 and Directive 2002/58/EC of the European Directive 2002/58/EC of the European Parliament and of the Council2 . Parliament and of the Council2 . ______1 Regulation (EU) 2016/679 of the 1 Regulation (EU) 2016/679 of the European Parliament and of the Council of European Parliament and of the Council of 27 April 2016 on the protection of natural 27 April 2016 on the protection of natural persons with regard to the processing of persons with regard to the processing of personal data and on the free movement of personal data and on the free movement of such data, and repealing Directive such data, and repealing Directive 95/46/EC (General Data Protection 95/46/EC (General Data Protection Regulation) (OJ L 119, 4.5.2016, p. 1). Regulation) (OJ L 119, 4.5.2016, p. 1). 2 Directive 2002/58/EC of the European 2 Directive 2002/58/EC of the European

PE652.548v02-00 12/117 AM\1206345EN.docx EN Parliament and of the Council of 12 July Parliament and of the Council of 12 July 2002 concerning the processing of personal 2002 concerning the processing of personal data and the protection of privacy in the data and the protection of privacy in the electronic communications sector electronic communications sector (Directive on privacy and electronic (Directive on privacy and electronic communications) (OJ L 201, 31.7.2002, p. communications) (OJ L 201, 31.7.2002, p. 37). 37).

Or. en

Amendment 447 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – recital 34

Motion for a resolution Amendment

(34) The ethical boundaries of the use of (34) In particular, the ethical artificial intelligence, robotics and related boundaries of the use of artificial technologies, including software, intelligence, robotics and related algorithms and data used or produced by technologies, including software, such technologies, should be duly algorithms and data used or produced by considered when using remote recognition such technologies, should be duly technologies, such as biometric considered when using remote recognition recognition, to automatically identify technologies, such as biometric individuals. When these technologies are recognition, to automatically identify used by public authorities during times of individuals. national emergency, such as during a national health crisis, the use should be proportionate and criteria for that use defined in order to be able to determine whether, when and how it should take place, and such use should be mindful of its psychological and sociocultural impact with due regard for human dignity and the fundamental rights set out in the Charter.

Or. en

Amendment 448 Sergey Lagodinsky, Alexandra Geese

AM\1206345EN.docx 13/117 PE652.548v02-00 EN Motion for a resolution Annex I – part B – recital 34

Motion for a resolution Amendment

(34) The ethical boundaries of the use of (34) The ethical boundaries of the use of artificial intelligence, robotics and related artificial intelligence, robotics and related technologies, including software, technologies, including software, algorithms and data used or produced by algorithms and data used or produced by such technologies, should be duly such technologies, should be duly considered when using remote recognition considered when using remote recognition technologies, such as biometric technologies, such as recognition of recognition, to automatically identify biometric features, notably facial individuals. When these technologies are recognition, to automatically identify used by public authorities during times of individuals. When these technologies are national emergency, such as during a used by public authorities, the use should national health crisis, the use should be always be voluntary, proportionate, proportionate and criteria for that use targeted and limited to specific objectives, defined in order to be able to determine restricted in time and carried out in whether, when and how it should take accordance with Union law, with due place, and such use should be mindful of regard to human rights and dignity, its psychological and sociocultural impact autonomy and self-determination of the with due regard for human dignity and individual, and the fundamental rights set the fundamental rights set out in the out in the Charter. Criteria for and limits Charter. to that use should be subjected to judicial review and submitted to democratic scrutiny and debate involving civil society, in order to determine whether, when and how it should take place, and such use should be mindful of its psychological and sociocultural impact.

Or. en

Amendment 449 Stéphane Séjourné, Karen Melchior, Liesje Schreinemacher, Adrián Vázquez Lázara

Motion for a resolution Annex I – part B – recital 34

Motion for a resolution Amendment

PE652.548v02-00 14/117 AM\1206345EN.docx EN considered when using remote recognition considered when using remote recognition technologies, such as biometric technologies, such as biometric recognition, to automatically identify recognition, to automatically identify individuals. When these technologies are individuals. When these technologies are used by public authorities during times of used by public authorities during times of national emergency, such as during a national emergency, such as during a national health crisis, the use should be national health crisis, the use should be proportionate and criteria for that use proportionate and temporary. Clear criteria defined in order to be able to determine for that use should be defined in order to whether, when and how it should take be able to determine whether, when and place, and such use should be mindful of how it should take place, and such use its psychological and sociocultural impact should be mindful of its psychological and with due regard for human dignity and the sociocultural impact with due regard for fundamental rights set out in the Charter. human dignity and the fundamental rights set out in the Charter.

Or. en

Amendment 450 Stéphane Séjourné, Karen Melchior, Liesje Schreinemacher, Adrián Vázquez Lázara

Motion for a resolution Annex I – part B – recital 35

Motion for a resolution Amendment

(35) Governance that is based on deleted relevant standards enhances safety and promotes the increase of citizens’ trust in the development, deployment and use of artificial intelligence, robotics and related technologies including software, algorithms and data used or produced by such technologies.

Or. en

Amendment 451 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – recital 35

AM\1206345EN.docx 15/117 PE652.548v02-00 EN Motion for a resolution Amendment

(35) Governance that is based on (35) Governance that is based on relevant standards enhances safety and relevant standards enhances safety and promotes the increase of citizens’ trust in promotes the increase of citizens’ trust in the development, deployment and use of the development, deployment and use of artificial intelligence, robotics and related high-risk artificial intelligence, robotics technologies including software, and related technologies including algorithms and data used or produced by software, algorithms and data used or such technologies. produced by such technologies.

Or. en

Amendment 452 Stéphane Séjourné, Karen Melchior, Liesje Schreinemacher, Adrián Vázquez Lázara

Motion for a resolution Annex I – part B – recital 35 a (new)

Motion for a resolution Amendment

(35a) Public authorities should conduct fundamental rights impact assessment before deploying high-risk technologies which replace public power decisions and which have a direct and significant impact on citizen’s rights and obligations. In addition, these technologies should allow for human verification and due process, especially in the areas of justice and law enforcement, where fundamental rights protected by the Charter, are at stake.

Or. en

Amendment 453 Stéphane Séjourné, Liesje Schreinemacher, Adrián Vázquez Lázara, Karen Melchior

Motion for a resolution Annex I – part B – recital 36

PE652.548v02-00 16/117 AM\1206345EN.docx EN Motion for a resolution Amendment

(36) Among the existing relevant (36) Developers, deployers and users governance standards are, for example, the should continue to observe the existing ‘Ethics Guidelines for Trustworthy AI’ relevant governance standards are, for drafted by the High-Level Expert Group on example, the ‘Ethics Guidelines for Artificial Intelligence set up by the Trustworthy AI’ drafted by the High-Level European Commission, and other technical Expert Group on Artificial Intelligence set standards adopted by the European up by the European Commission, and other Committee for Standardization (CEN), the technical standards adopted by the European Committee for Electrotechnical European Committee for Standardization Standardization (CENELEC), and the (CEN), the European Committee for European Telecommunications Standards Electrotechnical Standardization Institute (ETSI), at European level, the (CENELEC), and the European International Organization for Telecommunications Standards Institute Standardization (ISO) and the Institute of (ETSI), at European level, the International Electrical and Electronics Engineers Organization for Standardization (ISO) and (IEEE), at international level. the Institute of Electrical and Electronics Engineers (IEEE), at international level.

Or. en

Amendment 454 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – recital 36

Motion for a resolution Amendment

(36) Among the existing relevant (36) Among the existing relevant governance standards are, for example, the governance standards are, for example, the ‘Ethics Guidelines for Trustworthy AI’ ‘Ethics Guidelines for Trustworthy AI’ drafted by the High-Level Expert Group on drafted by the High-Level Expert Group on Artificial Intelligence set up by the Artificial Intelligence set up by the European Commission, and other technical European Commission, and technical standards adopted by the European standards such as those adopted by the Committee for Standardization (CEN), the European Committee for Standardization European Committee for Electrotechnical (CEN), the European Committee for Standardization (CENELEC), and the Electrotechnical Standardization European Telecommunications Standards (CENELEC), and the European Institute (ETSI), at European level, the Telecommunications Standards Institute International Organization for (ETSI), at European level, the International Standardization (ISO) and the Institute of Organization for Standardization (ISO) and Electrical and Electronics Engineers the Institute of Electrical and Electronics

AM\1206345EN.docx 17/117 PE652.548v02-00 EN (IEEE), at international level. Engineers (IEEE), at international level.

Or. en

Amendment 455 Ibán García Del Blanco

Motion for a resolution Annex I – part B – recital 37

Motion for a resolution Amendment

(37) Sharing and use of data by multiple (37) Sharing and use of data by multiple participants is sensitive and therefore the participants is sensitive and therefore the development, deployment and use of development, deployment and use of artificial intelligence, robotics and related artificial intelligence, robotics and related technologies should be governed by technologies should be governed by relevant standards and protocols reflecting relevant standards and protocols reflecting the requirements of quality, integrity, the requirements of quality, integrity, security, privacy and control. The data security, privacy and control. The data governance strategy should focus on the governance strategy should focus on the processing, sharing of and access to such processing, sharing of and access to such data, including its proper management and data, including its proper management and traceability, and guarantee the adequate traceability, and guarantee the adequate protection of data belonging to vulnerable protection of data belonging to vulnerable groups, including people with disabilities, groups, including people with disabilities, patients, children, minorities and migrants. patients, children, minorities and migrants. In addition, developers, deployers and users could, where relevant, rely on key performance indicators in the assessment of the datasets they use in view of enhancing the trustworthiness of the technologies they develop, deploy and use.

Or. en

456 Daniel Buda

Motion for a resolution Annex I – part B – recital 37

Motion for a resolution Amendment

(37) Sharing and use of data by multiple (37) Sharing and use of data by multiple

PE652.548v02-00 18/117 AM\1206345EN.docx EN participants is sensitive and therefore the participants is sensitive and therefore the development, deployment and use of development, deployment and use of artificial intelligence, robotics and related artificial intelligence, robotics and related technologies should be governed by technologies should be governed by relevant standards and protocols reflecting relevant standards and protocols reflecting the requirements of quality, integrity, the requirements of quality, integrity, security, privacy and control. The data security, privacy and control. The data governance strategy should focus on the governance strategy should focus on the processing, sharing of and access to such processing, sharing of and access to such data, including its proper management and data, including its proper management and traceability, and guarantee the adequate traceability, and guarantee the adequate protection of data belonging to vulnerable protection of data belonging to vulnerable groups, including people with disabilities, groups, including people with disabilities, patients, children, minorities and migrants. patients, children, minorities and migrants or other groups at risk of exclusion;

Or. ro

Amendment 457 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – recital 37

Motion for a resolution Amendment

(37) Sharing and use of data by multiple (37) Sharing and use of data by multiple participants is sensitive and therefore the participants is sensitive and therefore the development, deployment and use of development, deployment and use of high- artificial intelligence, robotics and related risk artificial intelligence, robotics and technologies should be governed by related technologies should be governed by relevant standards and protocols reflecting relevant rules, standards and protocols the requirements of quality, integrity, reflecting the requirements of quality, security, privacy and control. The data integrity, security, privacy and control. The governance strategy should focus on the data governance strategy should focus on processing, sharing of and access to such the processing, sharing of and access to data, including its proper management and such data, including its proper management traceability, and guarantee the adequate and traceability, and guarantee the protection of data belonging to vulnerable adequate protection of data belonging to groups, including people with disabilities, vulnerable groups, including people with patients, children, minorities and migrants. disabilities, patients, children, minorities and migrants.

Or. en

AM\1206345EN.docx 19/117 PE652.548v02-00 EN Amendment 458 Esteban González Pons

Motion for a resolution Annex I – part B – recital 37

Motion for a resolution Amendment

(37) Sharing and use of data by multiple (37) Sharing and use of data by multiple participants is sensitive and therefore the participants is sensitive and therefore the development, deployment and use of development, deployment and use of artificial intelligence, robotics and related artificial intelligence, robotics and related technologies should be governed by technologies should be governed by relevant standards and protocols reflecting relevant standards and protocols reflecting the requirements of quality, integrity, the requirements of quality, integrity, security, privacy and control. The data security, reliability, privacy and control. governance strategy should focus on the The data governance strategy should focus processing, sharing of and access to such on the processing, sharing of and access to data, including its proper management and such data, including its proper management traceability, and guarantee the adequate and traceability, and guarantee the protection of data belonging to vulnerable adequate protection of data belonging to groups, including people with disabilities, vulnerable groups, including people with patients, children, minorities and migrants. disabilities, patients, children, minorities and migrants.

Or. es

Amendment 459 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – recital 37

Motion for a resolution Amendment

PE652.548v02-00 20/117 AM\1206345EN.docx EN protection of data belonging to vulnerable the adequate protection of data belonging groups, including people with disabilities, to vulnerable groups, including people with patients, children, minorities and migrants. disabilities, patients, children, minorities and migrants.

Or. en

Amendment 460 Stéphane Séjourné, Karen Melchior, Liesje Schreinemacher, Adrián Vázquez Lázara

Motion for a resolution Annex I – part B – recital 38

Motion for a resolution Amendment

(38) The effective application of the (38) Member States should appoint ethical principles laid down in this independent public authority to act as a Regulation will largely depend on supervisory authority. Each national Member States’ appointment of an supervisory authority should be responsible independent public authority to act as a for assessing the compliance of high-risk supervisory authority. In particular, each technologies with this regulation. national supervisory authority should be responsible for assessing and monitoring the compliance of artificial intelligence, robotics and related technologies considered a high-risk in light of the obligations set out in this Regulation.

Or. en

Amendment 461 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – recital 38

Motion for a resolution Amendment

AM\1206345EN.docx 21/117 PE652.548v02-00 EN for assessing and monitoring the supervisory authority should be responsible compliance of artificial intelligence, for assessing and monitoring the robotics and related technologies compliance of artificial intelligence, considered a high-risk in light of the robotics and related technologies obligations set out in this Regulation. considered a high-risk in light of the obligations set out in this Regulation.

Or. en

Amendment 462 Evelyne Gebhardt, Brando Benifei, Bettina Vollath

Motion for a resolution Annex I – part B – recital 38

Motion for a resolution Amendment

(38) The effective application of the (38) The effective application of the ethical principles laid down in this ethical principles laid down in this Regulation will largely depend on Member Regulation will largely depend on Member States’ appointment of an independent States’ appointment of an independent public authority to act as a supervisory public authority to act as a supervisory authority. In particular, each national authority. In particular, each national supervisory authority should be responsible supervisory authority should be responsible for assessing and monitoring the for identifying artificial intelligence, compliance of artificial intelligence, robotics and related technologies robotics and related technologies considered a high-risk and for assessing considered a high-risk in light of the and monitoring the compliance of these obligations set out in this Regulation. technologies in light of the obligations set out in this Regulation.

Or. en

Amendment 463 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – recital 38

Motion for a resolution Amendment

PE652.548v02-00 22/117 AM\1206345EN.docx EN public authority to act as a supervisory public authority to act as a supervisory authority. In particular, each national authority. In particular, each national supervisory authority should be responsible supervisory authority should be responsible for assessing and monitoring the for assessing and monitoring the compliance of artificial intelligence, compliance of artificial intelligence, robotics and related technologies robotics and related technologies considered a high-risk in light of the considered high-risk in light of the obligations set out in this Regulation. objective criteria set out in this Regulation.

Or. en

Amendment 464 Evelyne Gebhardt, Brando Benifei, Bettina Vollath

Motion for a resolution Annex I – part B – recital 39

Motion for a resolution Amendment

(39) Each national supervisory authority (39) Each national supervisory authority shall also carry the responsibility of shall also carry the responsibility of the regulating the governance of these governance of these technologies in technologies. They therefore have an accordance with a common framework important role to play in promoting the prepared by the European Commission or trust and safety of Union citizens, as well another relevant institution, body, office as in enabling a democratic, pluralistic and or agency of the Union designated for this equitable society. task. They therefore have an important role to play in promoting the trust and safety of Union citizens, as well as in enabling a democratic, pluralistic and equitable society.

Or. en

Amendment 465 Stéphane Séjourné, Karen Melchior, Liesje Schreinemacher, Adrián Vázquez Lázara

Motion for a resolution Annex I – part B – recital 39

Motion for a resolution Amendment

(39) Each national supervisory authority (39) Each national supervisory authority shall also carry the responsibility of will have an important role to play in regulating the governance of these promoting the trust and safety of Union

AM\1206345EN.docx 23/117 PE652.548v02-00 EN technologies. They therefore have an citizens, as well as in enabling a important role to play in promoting the democratic, pluralistic and equitable trust and safety of Union citizens, as well society. as in enabling a democratic, pluralistic and equitable society.

Or. en

Amendment 466 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – recital 39

Motion for a resolution Amendment

(39) Each national supervisory authority (39) Each competent supervisory shall also carry the responsibility of authority shall also carry the responsibility regulating the governance of these of regulating the governance of these technologies. They therefore have an technologies. They therefore have an important role to play in promoting the important role to play in promoting the trust and safety of Union citizens, as well trust and safety of Union citizens, as well as in enabling a democratic, pluralistic and as in enabling a democratic, pluralistic and equitable society. equitable society.

Or. en

Amendment 467 Evelyne Gebhardt, Brando Benifei, Bettina Vollath

Motion for a resolution Annex I – part B – recital 39 a (new)

Motion for a resolution Amendment

(39a) National supervisory authorities shall cooperate with the authorities responsible for assessing and monitoring artificial intelligence, robotics and related technologies, including the software, algorithms and data used or produced by such technologies and enforcing their compliance in the light of sectorial legislation in order to identify technologies which are high-risk from an

PE652.548v02-00 24/117 AM\1206345EN.docx EN ethical perspective and in order to supervise the implementation of required and appropriate measures where such technologies are identified;

Or. en

Amendment 468 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – recital 40

Motion for a resolution Amendment

(40) National supervisory authorities (40) Competent supervisory authorities should engage in substantial and regular should engage in substantial and regular cooperation with each other, as well as cooperation with each other, as well as with the European Commission and other with the European Commission and other relevant institutions, bodies, offices and relevant institutions, bodies, offices and agencies of the Union, in order to agencies of the Union, in order to guarantee a coherent cross-border action, guarantee a coherent cross-border action, and allow for consistent development, and allow for consistent development, deployment and use of these technologies deployment and use of these technologies within the Union in compliance with the within the Union in compliance with the ethical principles laid down in this ethical principles laid down in this Regulation. Regulation.

Or. en

Amendment 469 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – recital 40 a (new)

Motion for a resolution Amendment

(40a) In the context of such cooperation, national supervisory authorities, together with the European Commission and other relevant institutions, bodies, offices and agencies of the Union, should elaborate a common and exhaustive list of high-risk artificial intelligence, robotics and related

AM\1206345EN.docx 25/117 PE652.548v02-00 EN technologies in line with the criteria set out in this Regulation and develop common criteria and an application process should be developed for the granting of a European certificate of ethical compliance.

Or. en

Amendment 470 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – recital 41

Motion for a resolution Amendment

(41) National supervisory authorities (41) Competent supervisory authorities should ensure the gathering of a maximum should ensure the gathering of a maximum number of stakeholders such as industry, number of stakeholders such as industry, businesses, social partners, researchers, businesses, social partners, researchers, consumers and civil society organisations, consumers and civil society organisations, and provide a pluralistic forum for and provide a pluralistic forum for reflection and exchange of views so as to reflection and exchange of views, to achieve comprehensible and accurate facilitate cooperation and collaboration conclusions for the purpose of guiding how between stakeholders, in particular from governance is regulated. academia, research, industry, civil society and individual experts, so as to achieve comprehensible and accurate conclusions for the purpose of guiding how governance is regulated.

Or. en

Amendment 471 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – recital 42

Motion for a resolution Amendment

(42) Additionally, these national (42) Additionally, these competent supervisory authorities should provide supervisory authorities should provide professional administrative guidance and professional administrative guidance and

PE652.548v02-00 26/117 AM\1206345EN.docx EN support to developers, deployers and users, support to developers, deployers and users, particularly small and medium-sized particularly small and medium-sized enterprises or start-ups, encountering enterprises or start-ups, encountering challenges as regards complying with the challenges as regards complying with the principles laid down in this Regulation. principles laid down in this Regulation.

Or. en

Amendment 472 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – recital 42 a (new)

Motion for a resolution Amendment

(42a) Full harmonisation approach is needed at the European level. Therefore, the European Commission shall be tasked to find an appropriate solution to structure such an approach. The goal is to avoid creation of another one agency. Instead, we have to find strict rules and guidelines for cooperation between Member States.

Or. en

Amendment 473 Stéphane Séjourné, Karen Melchior, Liesje Schreinemacher, Adrián Vázquez Lázara

Motion for a resolution Annex I – part B – recital 42 a (new)

Motion for a resolution Amendment

(42a) The Commission should establish binding guidelines to be followed by the national supervisory authorities when conducting their compliance assessment.

Or. en

AM\1206345EN.docx 27/117 PE652.548v02-00 EN Amendment 474 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – recital 43

Motion for a resolution Amendment

(43) Whistle-blowing brings potential deleted and actual breaches of Union law to the attention of authorities with a view to preventing injury, harm or damage that would otherwise occur. In addition, reporting procedures ameliorate the information flow within companies and organisations, thus mitigating the risk of flawed or erroneous products or services being developed. Companies and organisations developing, deploying or using artificial intelligence, robotics and related technologies, including data used or produced by those technologies, should set up reporting channels and persons reporting breaches should be protected from retaliation.

Or. en

Amendment 475 Stéphane Séjourné, Karen Melchior, Liesje Schreinemacher, Adrián Vázquez Lázara

Motion for a resolution Annex I – part B – recital 44

Motion for a resolution Amendment

(44) The rapid development of artificial (44) The rapid development of artificial intelligence, robotics and related intelligence, robotics and related technologies, including the software, technologies, including the software, algorithms and data used or produced by algorithms and data used or produced by such technologies, as well as of the such technologies, as well as of the technical machine learning, reasoning technical machine learning, reasoning processes and other technologies processes and other technologies underlying that development are underlying that development are unpredictable. As such, it is both unpredictable. As such, it is both appropriate and necessary to establish a appropriate and necessary to establish a review mechanism in accordance with review mechanism in accordance with

PE652.548v02-00 28/117 AM\1206345EN.docx EN which, in addition to its reporting on the which, in addition to its reporting on the application of the Regulation, the application of the Regulation, the Commission is to regularly submit a report Commission is to regularly submit a report concerning the possible modification of the concerning the possible modification of the scope of application of this Regulation. scope of application of this Regulation. In addition, the Commission should review, if necessary, every six months the annex of this Regulation by means of delegated act.

Or. en

Amendment 476 Ibán García Del Blanco

Motion for a resolution Annex I – part B – recital 45

Motion for a resolution Amendment

(45) Since the objective of this (45) Since the objective of this Regulation, namely to establish a legal Regulation, namely to establish a common framework of ethical principles for the legal framework of ethical principles for development, deployment and use of the development, deployment and use of artificial intelligence, robotics and related artificial intelligence, robotics and related technologies in the Union, cannot be technologies in the Union, cannot be sufficiently achieved by the Member sufficiently achieved by the Member States, but can rather, by reason of its scale States, but can rather, by reason of its scale and effects, be better achieved at Union and effects, be better achieved at Union level, the Union may adopt measures, in level, the Union may adopt measures, in accordance with the principle of accordance with the principle of subsidiarity as set out in Article 5 of the subsidiarity as set out in Article 5 of the Treaty on European Union. In accordance Treaty on European Union. In accordance with the principle of proportionality, as set with the principle of proportionality, as set out in that Article, this Regulation does not out in that Article, this Regulation does not go beyond what is necessary in order to go beyond what is necessary in order to achieve that objective. achieve that objective.

Or. en

Amendment 477 Marion Walsmann

Motion for a resolution Annex I – part B – recital 46

AM\1206345EN.docx 29/117 PE652.548v02-00 EN Motion for a resolution Amendment

(46) Action at Union level as set out in deleted this Regulation would be best achieved through the establishment of a European Agency for Artificial Intelligence. Such a body would be essential in coordinating the mandates and actions of the national supervisory authorities in each Member State, outlining objective criteria for the risk assessment of artificial intelligence, robotics and related technologies, developing and issuing a certification of compliance with the ethical principles laid down in this Regulation, supporting regular exchanges with concerned stakeholders and civil society, promoting the Union’s approach through international cooperation and ensuring a consistent reply worldwide to the opportunities and risks inherent in these technologies.

Or. de

Amendment 478 Daniel Buda

Motion for a resolution Annex I – part B – recital 46

Motion for a resolution Amendment

PE652.548v02-00 30/117 AM\1206345EN.docx EN regular exchanges with concerned stakeholders and civil society, promoting the Union’s approach through international cooperation and ensuring a consistent reply worldwide to the opportunities and risks inherent in these technologies.

Or. ro

Amendment 479 Raffaele Stancanelli

Motion for a resolution Annex I – part B – recital 46

Motion for a resolution Amendment

Or. it

Amendment 480 Stéphane Séjourné, Karen Melchior, Liesje Schreinemacher, Adrián Vázquez Lázara

AM\1206345EN.docx 31/117 PE652.548v02-00 EN Motion for a resolution Annex I – part B – recital 46

Motion for a resolution Amendment

Or. en

Amendment 481 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – recital 46

Motion for a resolution Amendment

PE652.548v02-00 32/117 AM\1206345EN.docx EN compliance with the ethical principles laid down in this Regulation, supporting regular exchanges with concerned stakeholders and civil society, promoting the Union’s approach through international cooperation and ensuring a consistent reply worldwide to the opportunities and risks inherent in these technologies.

Or. en

Amendment 482 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – recital 46

Motion for a resolution Amendment

(46) Action at Union level as set out in (46) Action at Union level as set out in this Regulation would be best achieved this Regulation would be best achieved through the establishment of a European through the establishment of a European Agency for Artificial Intelligence. Such a Agency for Artificial Intelligence. Such a body would be essential in coordinating the body would be essential in coordinating the mandates and actions of the national mandates and actions of the competent supervisory authorities in each Member supervisory authorities in Member States, State, outlining objective criteria for the outlining objective criteria for the risk risk assessment of artificial intelligence, assessment of artificial intelligence, robotics and related technologies, robotics and related technologies, developing and issuing a certification of developing and issuing a certification of compliance with the ethical principles laid compliance with the ethical principles laid down in this Regulation, supporting regular down in this Regulation, supporting regular exchanges with concerned stakeholders exchanges with concerned stakeholders and civil society, promoting the Union’s and civil society, creating a centre of approach through international cooperation expertise, bringing together academia, and ensuring a consistent reply worldwide research, industry, and individual experts to the opportunities and risks inherent in at Union level to foster exchange of these technologies. knowledge and technical expertise, and promoting the Union’s approach through international cooperation and ensuring a consistent reply worldwide to the opportunities and risks inherent in these technologies.

Or. en

AM\1206345EN.docx 33/117 PE652.548v02-00 EN Amendment 483 Evelyne Gebhardt, Brando Benifei, Bettina Vollath

Motion for a resolution Annex I – part B – recital 46

Motion for a resolution Amendment

(46) Action at Union level as set out in (46) Action at Union level as set out in this Regulation would be best achieved this Regulation would be best achieved through the establishment of a European through the establishment of a European Agency for Artificial Intelligence. Such a Agency for Artificial Intelligence. Such a body would be essential in coordinating the body would be essential in coordinating the mandates and actions of the national mandates and actions of the national supervisory authorities in each Member supervisory authorities in each Member State, outlining objective criteria for the State, outlining objective criteria for the risk assessment of artificial intelligence, risk assessment of artificial intelligence, robotics and related technologies, robotics and related technologies, drafting developing and issuing a certification of a common framework for the governance compliance with the ethical principles laid of the development, deployment and use down in this Regulation, supporting regular of these technologies, developing and exchanges with concerned stakeholders issuing a certification of compliance with and civil society, promoting the Union’s the ethical principles laid down in this approach through international cooperation Regulation, supporting regular exchanges and ensuring a consistent reply worldwide with concerned stakeholders and civil to the opportunities and risks inherent in society, promoting the Union’s approach these technologies. through international cooperation and ensuring a consistent reply worldwide to the opportunities and risks inherent in these technologies.

Or. en

Amendment 484 Stéphane Séjourné, Karen Melchior, Liesje Schreinemacher, Adrián Vázquez Lázara

Motion for a resolution Annex I – part B – before Article 1 – chapter title (new)

Motion for a resolution Amendment

Chapter I: General provisions

Or. en

PE652.548v02-00 34/117 AM\1206345EN.docx EN Amendment 485 Daniel Buda

Motion for a resolution Annex I – part B – Article 1 – paragraph 1

Motion for a resolution Amendment

The purpose of this Regulation is to The purpose of this Regulation is to establish a regulatory framework of ethical establish a comprehensive and forward- principles for the development, deployment looking regulatory framework of ethical and use of artificial intelligence, robotics principles for the development, deployment and related technologies in the Union. and use of artificial intelligence, robotics and related technologies in the Union.

Or. ro

Amendment 486 Ibán García Del Blanco

Motion for a resolution Annex I – part B – Article 1 – paragraph 1

Motion for a resolution Amendment

The purpose of this Regulation is to The purpose of this Regulation is to establish a regulatory framework of ethical establish a European common legal principles for the development, deployment regulatory framework of ethical principles and use of artificial intelligence, robotics for the development, deployment and use and related technologies in the Union. of artificial intelligence, robotics and related technologies in the Union.

Or. en

Amendment 487 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – Article 1 – paragraph 1

Motion for a resolution Amendment

The purpose of this Regulation is to The purpose of this Regulation is to

AM\1206345EN.docx 35/117 PE652.548v02-00 EN establish a regulatory framework of ethical establish a regulatory framework of ethical principles for the development, deployment principles for the development, deployment and use of artificial intelligence, robotics and use of high-risk artificial intelligence, and related technologies in the Union. robotics and related technologies in the Union.

Or. en

Amendment 488 Stéphane Séjourné, Karen Melchior, Liesje Schreinemacher, Adrián Vázquez Lázara

Motion for a resolution Annex I – part B – Article 2 – paragraph 1

Motion for a resolution Amendment

This Regulation applies to artificial 1. This Regulation applies to high- intelligence, robotics and related risk artificial intelligence, robotics and technologies, including software, related technologies, hereafter “high-risk algorithms and data used or produced by technologies”1a including software, such technologies, developed, deployed or algorithms and data used or produced by used in the Union. such technologies developed, deployed or used in the Union. 2. Within the meaning of this Regulation are considered being high- risk technologies, technologies that: (a) are used in sectors, where given the characteristics of the activities typically undertaken, significant risks can be expected to occur from the viewpoint of protection of safety and fundamental rights and freedoms, and (b) are used in such a manner, that such risks can be expected to occur from the viewpoint of protection of safety and fundamental rights and freedoms 3. The high-risk technologies mentioned in Paragraph 2 shall be listed in an Annex to this Regulation. The Commission is empowered to adopt delegated acts in accordance with Article 16(a), to amend the exhaustive list, by: (a) including new types of high-risk artificial intelligence, robotics and related

PE652.548v02-00 36/117 AM\1206345EN.docx EN technologies; (b) deleting types of technologies that can no longer be considered to pose a high-risk; (c) changing the critical sectors for existing high-risk technologies. Any delegated act amending the Annex shall come into force six months after its adoption. When determining new critical sectors and/or high-risk technologies to be inserted by means of delegated acts in the Annex, the Commission shall take full account of the criteria set out in this Regulation, in particular those set out in paragraph 2 of this Article. ______1a From this point “artificial intelligence, robotics and related technologies” is replaced by “high-risk technologies” throughout the Regulation

Or. en

Amendment 489 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – Article 2 – paragraph 1

Motion for a resolution Amendment

This Regulation applies to artificial This Regulation applies to artificial intelligence, robotics and related intelligence, robotics and related technologies, including software, technologies, including software, algorithms and data used or produced by algorithms and data produced or destined such technologies, developed, deployed or to be used by such technologies, used in the Union. developed, deployed or used in the Union.

Or. en

Amendment 490 Geoffroy Didier, Andrzej Halicki, Axel Voss

AM\1206345EN.docx 37/117 PE652.548v02-00 EN Motion for a resolution Annex I – part B – Article 2 – paragraph 1

Motion for a resolution Amendment

This Regulation applies to artificial This Regulation applies to high-risk intelligence, robotics and related artificial intelligence, robotics and related technologies, including software, technologies, including software, algorithms and data used or produced by algorithms and data used or produced by such technologies, developed, deployed or such technologies, developed, deployed or used in the Union. used in the Union.

Or. en

Amendment 491 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – Article 2 – paragraph 1 a (new)

Motion for a resolution Amendment

1a. This Regulation shall not apply to artificial intelligence, robotics and related technologies, including software, algorithms and data used or produced by such technologies, developed, deployed or used in the Union which are not considered high-risk.

Or. en

Amendment 492 Daniel Buda

Motion for a resolution Annex I – part B – Article 4 – paragraph 1 – point a

Motion for a resolution Amendment

(a) ‘artificial intelligence’ means (a) ‘artificial intelligence systems’ software systems that, inter alia, collect, means systems that display intelligent process and interpret structured or behaviour by analysing certain input and unstructured data, identify patterns and taking action, with some degree of establish models in order to reach autonomy, to achieve specific goals. AI-

PE652.548v02-00 38/117 AM\1206345EN.docx EN conclusions or take actions in the physical systems can be purely software-based, or virtual dimension based on such acting in the virtual world, or can be conclusions; embedded in hardware devices;

Or. ro

Amendment 493 Marion Walsmann

Motion for a resolution Annex I – part B – Article 4 – paragraph 1 – point a

Motion for a resolution Amendment

(a) ‘artificial intelligence’ means (a) ‘artificial intelligence’ means software systems that, inter alia, collect, methods and procedures that enable process and interpret structured or technical systems to perceive their unstructured data, identify patterns and environment, process what is perceived establish models in order to reach and solve problems independently, make conclusions or take actions in the physical decisions, act and learn from the or virtual dimension based on such consequences of those decisions and conclusions; actions;

Or. de

Amendment 494 Stéphane Séjourné, Liesje Schreinemacher, Karen Melchior, Adrián Vázquez Lázara

Motion for a resolution Annex I – part B – Article 4 – paragraph 1 – point a

Motion for a resolution Amendment

(a) ‘artificial intelligence’ means (a) ‘artificial intelligence’ means a software systems that, inter alia, collect, system that displays intelligent behaviour process and interpret structured or by analysing their environment and unstructured data, identify patterns and taking actions, with some degree of establish models in order to reach autonomy, to achieve specific goals; AI- conclusions or take actions in the physical systems can be purely software-based, or virtual dimension based on such acting in the virtual world, or can be conclusions; embedded in hardware devices;

Or. en

AM\1206345EN.docx 39/117 PE652.548v02-00 EN Amendment 495 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – Article 4 – paragraph 1 – point a

Motion for a resolution Amendment

(a) ‘artificial intelligence’ means (a) ‘artificial intelligence’ means software systems that, inter alia, collect, software systems that, display intelligent process and interpret structured or behaviour by analysing certain input and unstructured data, identify patterns and taking action, with some degree of establish models in order to reach autonomy, to achieve specific goals. AI conclusions or take actions in the physical systems can be purely software-based, or virtual dimension based on such acting in virtual world, or can be conclusions; embedded in hardware devices;

Or. en

Amendment 496 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – Article 4 – paragraph 1 – point a

Motion for a resolution Amendment

(a) ‘artificial intelligence’ means (a) ‘artificial intelligence’ means software systems that, inter alia, collect, systems that display intelligent behaviour process and interpret structured or by, inter alia, collecting, processing, unstructured data, identify patterns and analysing, and interpreting their establish models in order to reach environment and taking actions, with conclusions or take actions in the physical some degree of autonomy, to achieve or virtual dimension based on such specific goals1a; conclusions; ______1a Definition as in the European Commission Communication COM(2018) 237 final, 25.04.2018, page 1, adapted.

Or. en

Amendment 497 Sergey Lagodinsky, Alexandra Geese

PE652.548v02-00 40/117 AM\1206345EN.docx EN Motion for a resolution Annex I – part B – Article 4 – paragraph 1 – point a a (new)

Motion for a resolution Amendment

(aa) ‘automated decision making’, decision support, or decision informing systems are procedures in which decisions are initially, partly or completely, delegated to another person or corporate entity by way of using a software or a service, who then in turn use automatically executed decision-making models to perform an action;

Or. en

Amendment 498 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – Article 4 – paragraph 1 – point b

Motion for a resolution Amendment

(b) ‘robotics’ means technologies that (b) ‘robotics’ means automatically enable machines to perform tasks controlled, reprogrammable, multi- traditionally performed by human beings purpose machines1a to perform actions in including by way of artificial intelligence the physical world including by way of or related technologies; artificial intelligence or related technologies; ______1a From the definition for industrial robots in ISO 8373.

Or. en

Amendment 499 Caterina Chinnici

Motion for a resolution Annex I – part B – Article 4 – paragraph 1 – point b

AM\1206345EN.docx 41/117 PE652.548v02-00 EN Motion for a resolution Amendment

(b) ‘robotics’ means technologies that (b) ‘robotics’ means technologies that enable machines to perform tasks enable machines to perform tasks traditionally performed by human beings traditionally performed or initiated by including by way of artificial intelligence human beings including by way of or related technologies; artificial intelligence or related technologies;

Or. en

Amendment 500 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – Article 4 – paragraph 1 – point c

Motion for a resolution Amendment

(c) ‘related technologies’ means deleted technologies that enable software to control with a partial or full degree of autonomy a physical or virtual process, technologies capable of detecting the identity of persons or specific features of persons by way of their biometric data, and technologies that copy or otherwise make use of human traits;

Or. en

Amendment 501 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – Article 4 – paragraph 1 – point d

Motion for a resolution Amendment

(d) ‘software’ means a set of deleted instructions that are expressed in code and necessary for a computer to operate and to execute tasks;

PE652.548v02-00 42/117 AM\1206345EN.docx EN Or. en

Amendment 502 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – Article 4 – paragraph 1 – point e

Motion for a resolution Amendment

(e) ‘algorithms’ means a model for deleted calculations or other problem-solving operations carried out by software when executing a task;

Or. en

Amendment 503 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – Article 4 – paragraph 1 – point f

Motion for a resolution Amendment

(f) ‘data’ means information defined deleted as and stored in code;

Or. en

Amendment 504 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – Article 4 – paragraph 1 – point f a (new)

Motion for a resolution Amendment

(fa) ‘autonomous’ means an artificial intelligence, robotics or related technology that operates by perceiving certain input and without needing to follow a set of pre-determined

AM\1206345EN.docx 43/117 PE652.548v02-00 EN instructions, despite its behaviour being constrained by the goal it was given and other relevant design choices made by its developer;

Or. en

Amendment 505 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – Article 4 – paragraph 1 – point f b (new)

Motion for a resolution Amendment

(fb) ‘high risk’ means a significant potential in an autonomously operating artificial intelligence, robotics and related technology to cause harm or damage to one or more persons in a manner that is random and impossible to predict in advance, considering its intended use and the critical sector where it is employed;[FDCM1] the significance of the potential depends on the interplay between the severity of possible harm or damage, the likelihood that the risk materialises and the manner in which the AI-system is being used;

Or. en

Amendment 506 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – Article 4 – paragraph 1 – point g

Motion for a resolution Amendment

(g) ‘development’ means the deleted construction and design of algorithms, the writing and design of software or the collection, storing and management of data for the purpose of creating or

PE652.548v02-00 44/117 AM\1206345EN.docx EN training artificial intelligence, robotics and related technologies or for the purpose of creating a new application for existing artificial intelligence, robotics and related technologies;

Or. en

Amendment 507 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – Article 4 – paragraph 1 – point h

Motion for a resolution Amendment

(h) ‘developer’ means any natural or deleted legal person who takes decisions that determine and control the course or manner of the development of artificial intelligence, robotics and related technologies;

Or. en

Amendment 508 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – Article 4 – paragraph 1 – point i

Motion for a resolution Amendment

(i) ‘deployment’ means the operation deleted and management of artificial intelligence, robotics and related technologies, as well as their placement on the market or otherwise making them available to users;

Or. en

Amendment 509 Sergey Lagodinsky, Alexandra Geese

AM\1206345EN.docx 45/117 PE652.548v02-00 EN Motion for a resolution Annex I – part B – Article 4 – paragraph 1 – point j

Motion for a resolution Amendment

(j) ‘deployer’ means any natural or deleted legal person who is involved in the deployment of artificial intelligence, robotics and related technologies, and has an operating or managing function;

Or. en

Amendment 510 Marion Walsmann

Motion for a resolution Annex I – part B – Article 4 – paragraph 1 – point j

Motion for a resolution Amendment

(j) ‘deployer’ means any natural or (j) ‘deployer’ means any natural or legal person who is involved in the legal person who decides on the practical deployment of artificial intelligence, deployment of artificial intelligence, robotics and related technologies, and has robotics and related technologies, exercises an operating or managing function; control over the risk and who benefits from its deployment;

Or. de

Amendment 511 Daniel Buda

Motion for a resolution Annex I – part B – Article 4 – paragraph 1 – point j

Motion for a resolution Amendment

(j) ‘deployer’ means any natural or (j) ‘deployer’ means the person who legal person who is involved in the decides on the use of the AI-system, deployment of artificial intelligence, exercises control over the associated risk robotics and related technologies, and has and benefits from its operation; an operating or managing function;

PE652.548v02-00 46/117 AM\1206345EN.docx EN Or. ro

Amendment 512 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – Article 4 – paragraph 1 – point k

Motion for a resolution Amendment

(k) ‘use’ means any action relating to deleted artificial intelligence, robotics and related technologies other than development or deployment;

Or. en

Amendment 513 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – Article 4 – paragraph 1 – point l

Motion for a resolution Amendment

(l) ‘user’ means any natural or legal deleted person who uses artificial intelligence, robotics and related technologies other than for the purposes of development or deployment;

Or. en

Amendment 514 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – Article 4 – paragraph 1 – point m

Motion for a resolution Amendment

(m) ‘bias’ means any prejudiced or deleted partial personal or social perception of a

AM\1206345EN.docx 47/117 PE652.548v02-00 EN person or group of persons on the basis of their personal traits;

Or. en

Amendment 515 Marion Walsmann

Motion for a resolution Annex I – part B – Article 4 – paragraph 1 – point m

Motion for a resolution Amendment

(m) ‘bias’ means any prejudiced or (m) ‘bias’ means any prejudiced or partial personal or social perception of a personal or social perception of a person or person or group of persons on the basis of group of persons on the basis of their their personal traits; personal traits;

Or. de

Amendment 516 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – Article 4 – paragraph 1 – point n

Motion for a resolution Amendment

(n) ‘discrimination’ means any deleted differential treatment of a person or group of persons based on a ground which has no objective or reasonable justification and is therefore prohibited by Union law;

Or. en

Amendment 517 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – Article 4 – paragraph 1 – point o

PE652.548v02-00 48/117 AM\1206345EN.docx EN Motion for a resolution Amendment

(o) ‘injury or harm’ means physical, deleted emotional or mental injury, bias, discrimination or stigmatization, suffering caused by a lack of inclusivity and diversity, financial or economic loss, loss of employment or educational opportunity, undue restriction of freedom of choice, wrongful conviction, environmental harm and any infringement of Union law that is detrimental to a person;

Or. en

Amendment 518 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – Article 4 – paragraph 1 – point o

Motion for a resolution Amendment

(o) ‘injury or harm’ means physical, (o) ‘injury or harm’ means physical or emotional or mental injury, bias, mental injury, such as hate speech, loss of discrimination or stigmatization, suffering privacy bias, financial or economic loss, caused by a lack of inclusivity and loss of employment or educational diversity, financial or economic loss, loss opportunity, undue restriction of freedom of employment or educational opportunity, of choice, and expression and any undue restriction of freedom of choice, infringement of Union law that is wrongful conviction, environmental harm detrimental to a person; and any infringement of Union law that is detrimental to a person;

Or. en

Amendment 519 Emmanuel Maurel, Manon Aubry

Motion for a resolution Annex I – part B – Article 4 – paragraph 1 – point o

AM\1206345EN.docx 49/117 PE652.548v02-00 EN Motion for a resolution Amendment

(o) ‘injury or harm’ means physical, (o) ‘injury or harm’ means physical, emotional or mental injury, bias, psychological or mental injury, bias, discrimination or stigmatization, suffering discrimination or stigmatization, resulting caused by a lack of inclusivity and in particular from a violation of diversity, financial or economic loss, loss inclusivity and diversity, financial or of employment or educational opportunity, economic loss, loss of employment or undue restriction of freedom of choice, educational opportunity, undue restriction wrongful conviction, environmental harm of freedom of choice, wrongful conviction, and any infringement of Union law that is environmental harm and any infringement detrimental to a person; of Union law that is detrimental to a person;

Or. fr

Amendment 520 Stéphane Séjourné, Karen Melchior, Liesje Schreinemacher, Adrián Vázquez Lázara

Motion for a resolution Annex I – part B – Article 4 – paragraph 1 – point p

Motion for a resolution Amendment

(p) ‘governance’ means the manner of deleted ensuring that the highest standards and the appropriate protocols of behaviour are adopted and observed by developers, deployers and users, based on a formal set of rules, procedures and values, and which allows them to deal appropriately with ethical matters as or before they arise.

Or. en

Amendment 521 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – Article 4 – paragraph 1 – point p

PE652.548v02-00 50/117 AM\1206345EN.docx EN Motion for a resolution Amendment

Or. en

Amendment 522 Marion Walsmann

Motion for a resolution Annex I – part B – Article 4 – paragraph 1 – point p

Motion for a resolution Amendment

(p) ‘governance’ means the manner of (p) ‘governance’ means the manner of ensuring that the highest standards and the ensuring that the appropriate standards and appropriate protocols of behaviour are protocols of behaviour are adopted and adopted and observed by developers, observed by developers, deployers and deployers and users, based on a formal set users, based on a formal set of rules, of rules, procedures and values, and which procedures and values, and which allows allows them to deal appropriately with them to deal appropriately with ethical ethical matters as or before they arise. matters as or before they arise.

Or. de

Amendment 523 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – Article 4 – paragraph 1 – point p

Motion for a resolution Amendment

AM\1206345EN.docx 51/117 PE652.548v02-00 EN adopted and observed by developers, observed by developers, deployers and deployers and users, based on a formal set users, based on a formal set of rules, of rules, procedures and values, and which procedures and values, and which allows allows them to deal appropriately with them to deal appropriately with ethical ethical matters as or before they arise. matters as or before they arise.

Or. en

Amendment 524 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – Article 5 – paragraph 1

Motion for a resolution Amendment

Or. en

Amendment 525 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – Article 5 – paragraph 1

Motion for a resolution Amendment

Or. en

PE652.548v02-00 52/117 AM\1206345EN.docx EN Amendment 526 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – Article 5 – paragraph 2

Motion for a resolution Amendment

2. The development, deployment and 2. The development, deployment and use of artificial intelligence, robotics and use of high-risk artificial intelligence, related technologies, including software, robotics and related technologies, including algorithms and data used or produced by software, algorithms and data used or such technologies, shall be carried out in a produced by such technologies, shall be manner that ensures that human dignity carried out in the best interest of citizens and the fundamental rights set out in the and contribute to protect the social, Charter are fully respected. economic and well-being of society by ensuring that human dignity and the fundamental rights set out in the Charter are fully respected.

Or. en

Amendment 527 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – Article 5 – paragraph 3

Motion for a resolution Amendment

3. The development, deployment and deleted use of development, deployment and use of artificial intelligence, robotics and related technologies, including software, algorithms and data used or produced by such technologies, shall be carried out in the best interest of citizens. In particular, the potential of such technologies and the opportunities that they provide shall be taken into consideration having regard at all times to the need to protect and foster the social, environmental and economic well-being of society.

Or. en

AM\1206345EN.docx 53/117 PE652.548v02-00 EN Amendment 528 Stéphane Séjourné, Liesje Schreinemacher, Karen Melchior, Adrián Vázquez Lázara

Motion for a resolution Annex I – part B – Article 5 – paragraph 3

Motion for a resolution Amendment

Or. en

Amendment 529 Raffaele Stancanelli

Motion for a resolution Annex I – part B – Article 5 – paragraph 3

Motion for a resolution Amendment

3. The development, deployment and 3. The development, deployment and use of development, deployment and use of use of development, deployment and use of artificial intelligence, robotics and related artificial intelligence, robotics and related technologies, including software, technologies, including software, algorithms and data used or produced by algorithms and data used or produced by such technologies, shall be carried out in such technologies, shall be carried out in the best interest of citizens. In particular, the best interest of citizens. In particular, the potential of such technologies and the the potential of such technologies and the opportunities that they provide shall be opportunities that they provide shall be taken into consideration having regard at taken into consideration, having regard at all times to the need to protect and foster all times to the centrality and the social, environmental and economic irreplaceability of human beings and the well-being of society. need to protect and foster the social,

PE652.548v02-00 54/117 AM\1206345EN.docx EN environmental and economic well-being of society.

Or. it

Amendment 530 Stéphane Séjourné, Karen Melchior, Liesje Schreinemacher, Adrián Vázquez Lázara

Motion for a resolution Annex I – part B – after article 5 – chapter title (new)

Motion for a resolution Amendment

Chapter II: Obligations for high-risk technologies

Or. en

Amendment 531 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – Article 6 – title

Motion for a resolution Amendment

Human-centric and human-made artificial Human-centric artificial intelligence intelligence

Or. en

Amendment 532 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – Article 6 – paragraph 1

Motion for a resolution Amendment

AM\1206345EN.docx 55/117 PE652.548v02-00 EN produced by such technologies, shall be algorithms and data used or produced by developed, deployed and used in a human- such technologies, shall be developed, centric manner with the aim of contributing deployed and used in a human-centric to the existence of a democratic, pluralistic manner with the aim of contributing to the and equitable society by safeguarding existence of a democratic, pluralistic and human autonomy and decision-making and equitable society by safeguarding human ensuring human agency. autonomy and decision-making and ensuring human agency.

Or. en

Amendment 533 Stéphane Séjourné, Karen Melchior, Liesje Schreinemacher, Adrián Vázquez Lázara

Motion for a resolution Annex I – part B – Article 6 – paragraph 1

Motion for a resolution Amendment

1. Any artificial intelligence, robotics 1. High-risk technologies, including and related technologies, including software, algorithms and data used or software, algorithms and data used or produced by such technologies, shall: produced by such technologies, shall be developed, deployed and used in a human- centric manner with the aim of contributing to the existence of a democratic, pluralistic and equitable society by safeguarding human autonomy and decision-making and ensuring human agency. (a) be developed, deployed and used in a human-centric manner with the aim of contributing to the existence of a democratic, pluralistic and equitable society by safeguarding human autonomy and decision-making and ensuring human agency;

Or. en

Amendment 534 Stéphane Séjourné, Karen Melchior, Liesje Schreinemacher, Adrián Vázquez Lázara

Motion for a resolution Annex I – part B – Article 6 – paragraph 2

PE652.548v02-00 56/117 AM\1206345EN.docx EN Motion for a resolution Amendment

2. The technologies listed in (b) be developed, deployed and used paragraph 1 shall be developed, deployed in a manner that guarantees full human and used in a manner that guarantees full oversight at any time; and human oversight at any time, in particular where that development, deployment or use entails a risk of breaching the ethical principles set out in this Regulation.

Or. en

Amendment 535 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – Article 6 – paragraph 2

Motion for a resolution Amendment

2. The technologies listed in 2. The technologies listed in paragraph 1 shall be developed, deployed paragraph 1 shall be developed, deployed and used in a manner that guarantees full and used in a manner that guarantees full human oversight at any time, in particular human oversight at any time. where that development, deployment or use entails a risk of breaching the ethical principles set out in this Regulation.

Or. en

Amendment 536 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – Article 6 – paragraph 2

Motion for a resolution Amendment

2. The technologies listed in 2. The technologies listed in paragraph 1 shall be developed, deployed paragraph 1 shall be developed, deployed and used in a manner that guarantees full and used in a manner that guarantees full human oversight at any time, in particular human oversight at any time, in particular where that development, deployment or where that development, deployment or use entails a risk of breaching the ethical use entails a risk of breaching Union law

AM\1206345EN.docx 57/117 PE652.548v02-00 EN principles set out in this Regulation. or the ethical principles set out in this Regulation.

Or. en

Amendment 537 Stéphane Séjourné, Karen Melchior, Liesje Schreinemacher, Adrián Vázquez Lázara

Motion for a resolution Annex I – part B – Article 6 – paragraph 3

Motion for a resolution Amendment

3. The technologies listed in (c) be developed, deployed and used paragraph 1 shall be developed, deployed in a manner that allows human control to and used in a manner that allows human be regained at any time, including through control to be regained at any time, the altering or halting of those including through the altering or halting of technologies. those technologies, when that development, deployment or use entails a risk of breaching the ethical principles set out in this Regulation.

Or. en

Amendment 538 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – Article 6 – paragraph 3

Motion for a resolution Amendment

3. The technologies listed in 3. The technologies listed in paragraph 1 shall be developed, deployed paragraph 1 shall be developed, deployed and used in a manner that allows human and used in a manner that allows human control to be regained at any time, control to be regained when needed, including through the altering or halting of including through the halting of those those technologies, when that technologies. development, deployment or use entails a risk of breaching the ethical principles set out in this Regulation.

Or. en

PE652.548v02-00 58/117 AM\1206345EN.docx EN Amendment 539 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – Article 6 – paragraph 3

Motion for a resolution Amendment

3. The technologies listed in 3. The technologies listed in paragraph 1 shall be developed, deployed paragraph 1 shall be developed, deployed and used in a manner that allows human and used in a manner that allows human control to be regained at any time, control to be regained at any time, including through the altering or halting of including through the altering or halting of those technologies, when that those technologies, when that development, deployment or use entails a development, deployment or use entails a risk of breaching the ethical principles set risk of breaching Union law or the ethical out in this Regulation. principles set out in this Regulation.

Or. en

Amendment 540 Stéphane Séjourné, Liesje Schreinemacher, Adrián Vázquez Lázara

Motion for a resolution Annex I – part B – Article 7

Motion for a resolution Amendment

Annex I – part B – Article 7 deleted Risk assessment 1. For the purposes of this Regulation, artificial intelligence, robotics and related technologies, including software, algorithms and data used or produced by such technologies, which entail a significant risk of breaching the ethical principles set out in this Regulation shall be considered high-risk technologies. 2. Where artificial intelligence, robotics and related technologies are considered high-risk technologies, an assessment of compliance of those technologies with the obligations set out

AM\1206345EN.docx 59/117 PE652.548v02-00 EN in this Regulation shall be carried out and monitored by the national supervisory authorities referred to in Annex I – part B – Article 14. 3. Without prejudice to paragraph 1, the risk assessment of artificial intelligence, robotics and related technologies, including software, algorithms and data used or produced by such technologies, shall be carried out on the basis of objective criteria harmonised at Union level and in accordance with applicable sectorial legislation.

Or. en

Amendment 541 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – Article 7 – paragraph 1

Motion for a resolution Amendment

1. For the purposes of this Regulation, 1. For the purposes of this Regulation, artificial intelligence, robotics and related artificial intelligence, robotics and related technologies, including software, technologies, including software, algorithms and data used or produced by algorithms and data used or produced by such technologies, which entail a such technologies, shall be considered significant risk of breaching the ethical high-risk technologies when, considering principles set out in this Regulation shall their intended use and the critical sectors be considered high-risk technologies. where they are employed in accordance with the Annex to this Regulation, their autonomous operation involves a significant potential to cause harm to one or more persons, in a manner that is random and impossible to predict in advance. Determining the significance of the potential shall depends on the interplay between the severity of possible harm or damage, the likelihood that the risk materializes and the manner in which the AI-system is being used.

Or. en

PE652.548v02-00 60/117 AM\1206345EN.docx EN Amendment 542 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – Article 7 – paragraph 1

Motion for a resolution Amendment

Or. en

Amendment 543 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – Article 7 – paragraph 1 a (new)

Motion for a resolution Amendment

1a. The risk assessment of artificial intelligence, robotics and related technologies, including software, algorithms and data used or produced by such technologies, shall be carried out by the national supervisory authorities referred to in Article 14 on the basis of a common and exhaustive list of high-risk artificial intelligence, robotics and related technologies in accordance with the objective criteria provided for in paragraph 1 of this Article and elaborated jointly by the national supervisory authorities, the European Commission and other relevant institutions, bodies, offices and agencies of the Union in the context of their cooperation.

AM\1206345EN.docx 61/117 PE652.548v02-00 EN Or. en

Amendment 544 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – Article 7 – paragraph 2

Motion for a resolution Amendment

2. Where artificial intelligence, 2. Where artificial intelligence, robotics and related technologies are robotics and related technologies are considered high-risk technologies, an considered high-risk technologies, an assessment of compliance of those assessment of compliance of those technologies with the obligations set out in technologies with the obligations set out in this Regulation shall be carried out and this Regulation shall be carried out and monitored by the national supervisory monitored by the competent supervisory authorities referred to in Article 14. authorities referred to in Article 14 or the European Agency for Artificial Intelligence.

Or. en

Amendment 545 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – Article 7 – paragraph 2 a (new)

Motion for a resolution Amendment

2a. Upon request by any developer, deployer or user of high-risk artificial intelligence, robotics and related technologies are considered high-risk technologies seeking to certify the positive assessment of compliance carried out, the respective national supervisory authority shall issue a European certificate of ethical compliance. Such a European certificate of ethical compliance shall be issued in accordance with the common criteria and an application process developed jointly by the national supervisory authorities, the

PE652.548v02-00 62/117 AM\1206345EN.docx EN European Commission and other relevant institutions, bodies, offices and agencies of the Union in the context of their cooperation.

Or. en

Amendment 546 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – Article 7 – paragraph 3

Motion for a resolution Amendment

3. Without prejudice to paragraph 1, deleted the risk assessment of artificial intelligence, robotics and related technologies, including software, algorithms and data used or produced by such technologies, shall be carried out on the basis of objective criteria harmonised at Union level and in accordance with applicable sectorial legislation.

Or. en

Amendment 547 Ibán García Del Blanco

Motion for a resolution Annex I – part B – Article 7 – paragraph 3

Motion for a resolution Amendment

3. Without prejudice to paragraph 1, 3. Without prejudice to paragraph 1, the risk assessment of artificial the risk assessment of artificial intelligence, robotics and related intelligence, robotics and related technologies, including software, technologies, including software, algorithms and data used or produced by algorithms and data used or produced by such technologies, shall be carried out on such technologies, shall be carried out on the basis of objective criteria harmonised at the basis of a risk-based approach and Union level and in accordance with objective criteria harmonised at Union applicable sectorial legislation. level and in accordance with applicable

AM\1206345EN.docx 63/117 PE652.548v02-00 EN sectorial legislation.

Or. en

Amendment 548 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – Article 7 a (new)

Motion for a resolution Amendment

Article 7a Voluntary labelling scheme for non high- risk AI technologies 1. For artificial intelligence, robotics and related technologies, including software, algorithms and data used or produced by such technologies that do not qualify as high-risk and that are not subject to the mandatory requirements and risk assessment established by this Regulation, a voluntary labelling scheme should be established. 2. Under such a voluntary labelling scheme, interested economic operators can decide to make themselves subject either to the requirements listed in this Regulation or to a specific set of similar requirements especially established for the purposes of the voluntary scheme by national authorities. 3. The economic operators concerned shall be awarded a quality label for their artificial intelligence, robotics and related technologies, including software, algorithms and data used or produced by such technologies, provided that those technologies comply with the applicable requirements in accordance with paragraph 2 of this Article.

Or. en

PE652.548v02-00 64/117 AM\1206345EN.docx EN Amendment 549 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – Article 8 – paragraph 1 – introductory part

Motion for a resolution Amendment

Or. en

Amendment 550 Stéphane Séjourné, Liesje Schreinemacher, Adrián Vázquez Lázara

Motion for a resolution Annex I – part B – Article 8 – paragraph 1 – point a

Motion for a resolution Amendment

(a) developed, deployed and used in a deleted consistent manner so that they do not pursue aims or do not carry out activities other than those for which they have been conceived;

Or. en

Amendment 551 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – Article 8 – paragraph 1 – point a

Motion for a resolution Amendment

(a) developed, deployed and used in a deleted

AM\1206345EN.docx 65/117 PE652.548v02-00 EN consistent manner so that they do not pursue aims or do not carry out activities other than those for which they have been conceived;

Or. en

Amendment 552 Ibán García Del Blanco

Motion for a resolution Annex I – part B – Article 8 – paragraph 1 – point b

Motion for a resolution Amendment

(b) developed, deployed and used in a (b) developed, deployed and used in a resilient manner so that they ensure an resilient manner so that they ensure an adequate level of security, and one that adequate level of security by adhering to prevents any technical vulnerabilities from minimum cybersecurity baselines being exploited for unfair or unlawful proportionate to identified risk, and one purposes; that prevents any technical vulnerabilities from being exploited for unfair or unlawful purposes;

Or. en

Amendment 553 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – Article 8 – paragraph 1 – point b

Motion for a resolution Amendment

(b) developed, deployed and used in a (b) developed, deployed and used in a resilient manner so that they ensure an resilient manner so that they ensure an adequate level of security, and one that adequate level of security, and one that prevents any technical vulnerabilities from prevents any technical vulnerabilities from being exploited for unfair or unlawful being exploited for malicious or unlawful purposes; purposes;

Or. en

PE652.548v02-00 66/117 AM\1206345EN.docx EN Amendment 554 Stéphane Séjourné, Karen Melchior, Liesje Schreinemacher, Adrián Vázquez Lázara

Motion for a resolution Annex I – part B – Article 8 – paragraph 1 – point b

Motion for a resolution Amendment

(b) developed, deployed and used in a (b) developed, deployed and used in a resilient manner so that they ensure an resilient manner so that they ensure an adequate level of security, and one that adequate level of security, and one that prevents any technical vulnerabilities from prevents any technical vulnerabilities from being exploited for unfair or unlawful being exploited for unlawful purposes; purposes;

Or. en

Amendment 555 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – Article 8 – paragraph 1 – point c

Motion for a resolution Amendment

(c) developed, deployed and used in a (c) developed, deployed and used in a secure manner that ensures there are secure manner that ensures there are safeguards that include a fall-back plan and safeguards that include a fall-back plan and action in case of a risk of a breach of the action in case of a risk of a safety or ethical principles set out in this security risk; Regulation;

Or. en

Amendment 556 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – Article 8 – paragraph 1 – point d

Motion for a resolution Amendment

(d) developed, deployed and used in a (d) developed, deployed and used in a manner that ensures that there is trust that manner that ensures that there is trust that the performance is reliable as regards the technology works as expected by its

AM\1206345EN.docx 67/117 PE652.548v02-00 EN reaching the aims and carrying out the user and performance is reliable as regards activities they have been conceived for, reaching the aims and carrying out the including by ensuring that all operations activities they have been conceived for, are reproducible; including by ensuring that all operations are reproducible;

Or. en

Amendment 557 Stéphane Séjourné, Karen Melchior, Liesje Schreinemacher, Adrián Vázquez Lázara

Motion for a resolution Annex I – part B – Article 8 – paragraph 1 – point d

Motion for a resolution Amendment

(d) developed, deployed and used in a (d) developed, deployed and used in a manner that ensures that there is trust that manner that ensures are reliable the performance is reliable as regards performance as regards reaching the aims reaching the aims and carrying out the and carrying out the activities they have activities they have been conceived for, been conceived for, including by ensuring including by ensuring that all operations that all operations are reproducible; are reproducible;

Or. en

Amendment 558 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – Article 8 – paragraph 1 – point d

Motion for a resolution Amendment

(d) developed, deployed and used in a (d) developed, deployed and used in a manner that ensures that there is trust that manner that ensures that the performance is the performance is reliable as regards reliable as regards reaching the aims and reaching the aims and carrying out the carrying out the activities they have been activities they have been conceived for, conceived for, including by ensuring that including by ensuring that all operations all operations are reproducible; are reproducible;

Or. en

PE652.548v02-00 68/117 AM\1206345EN.docx EN Amendment 559 Stéphane Séjourné, Karen Melchior, Liesje Schreinemacher, Adrián Vázquez Lázara

Motion for a resolution Annex I – part B – Article 8 – paragraph 1 – point e

Motion for a resolution Amendment

(e) developed, deployed and used in a (e) developed, deployed and used in a manner that ensures that the performance manner that ensures that the performance of the aims and activities of the particular of the aims and activities of the particular technologies is accurate; if occasional technologies is accurate; if occasional inaccuracies cannot be avoided, the system inaccuracies cannot be avoided, the system shall indicate the likeliness of errors and shall indicate, to the extent possible, the inaccuracies to deployers and users through likeliness of errors and inaccuracies to an appropriate disclaimer message; deployers and users through an appropriate disclaimer message;

Or. en

Amendment 560 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – Article 8 – paragraph 1 – point e

Motion for a resolution Amendment

(e) developed, deployed and used in a (e) developed, deployed and used in a manner that ensures that the performance manner that ensures that the performance of the aims and activities of the particular of the aims and activities of the particular technologies is accurate; if occasional technologies is accurate; if occasional inaccuracies cannot be avoided, the system inaccuracies cannot be avoided, the system shall indicate the likeliness of errors and shall indicate the likeliness of errors and inaccuracies to deployers and users inaccuracies to deployers and users through an appropriate disclaimer appropriately; message;

Or. en

Amendment 561 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – Article 8 – paragraph 1 – point f

AM\1206345EN.docx 69/117 PE652.548v02-00 EN Motion for a resolution Amendment

(f) developed, deployed and used in an (f) developed, deployed and used in an easily explainable manner so as to ensure easily explainable, auditable, traceable, that there can be a review of the technical and transparent manner so as to ensure processes of the technologies; that there can be a review of the technical processes of the technologies;

Or. en

Amendment 562 Stéphane Séjourné, Karen Melchior, Liesje Schreinemacher, Adrián Vázquez Lázara

Motion for a resolution Annex I – part B – Article 8 – paragraph 1 – point g

Motion for a resolution Amendment

(g) developed, deployed and used in a (g) developed, deployed and used in a manner such that they are capable of manner such that they inform users that warning users that they are interacting they are interacting with artificial with artificial intelligence systems, duly intelligence systems, duly and disclosing their capabilities, accuracy and comprehensively disclosing their limitations to artificial intelligence capabilities, accuracy and limitations to developers, deployers and users; developers, deployers and users of high- risk technologies;

Or. en

Amendment 563 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – Article 8 – paragraph 1 – point g

Motion for a resolution Amendment

(g) developed, deployed and used in a (g) developed, deployed and used in a manner such that they are capable of manner such that they are capable of warning users that they are interacting with warning users that they are interacting with artificial intelligence systems, duly artificial intelligence systems, duly disclosing their capabilities, accuracy and disclosing their capabilities, accuracy and limitations to artificial intelligence limitations to deployers and users; developers, deployers and users;

PE652.548v02-00 70/117 AM\1206345EN.docx EN Or. en

Amendment 564 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – Article 8 – paragraph 1 – point h

Motion for a resolution Amendment

(h) in accordance with Article 6(3), (h) in accordance with Article 6(3), developed, deployed and used in a manner developed, deployed and used in a manner that makes it possible, in the event of non- that makes it possible, in the event of non- compliance with the safety features set out compliance with the safety features set out in subparagraphs (a) to (g), for the in subparagraphs (a) to (g), for the technologies concerned to be temporarily technologies concerned to be temporarily disabled and to revert to historical disabled and to revert to a previous state, functionalities. identified as restoring safe functionalities.

Or. en

Amendment 565 Stéphane Séjourné, Karen Melchior, Liesje Schreinemacher, Adrián Vázquez Lázara

Motion for a resolution Annex I – part B – Article 8 – paragraph 2

Motion for a resolution Amendment

2. In accordance with Article 6(2), the 2. In accordance with Article 6(b), technologies mentioned in paragraph 1 high-risk technologies, including shall be developed, deployed and used in software, algorithms and data used or transparent and traceable manner so that produced by such technologies shall be their elements, processes and phases are developed, deployed and used in documented to the highest standards, and transparent and traceable manner so that that it is possible for the national their elements, processes and phases are supervisory authorities referred to in documented to the highest applicable Article 14 to assess the compliance of standards. In particular, the developer, such technologies with the obligations set deployer or user of those technologies shall out in this Regulation. In particular, the be responsible for, and be able to developer, deployer or user of those demonstrate, compliance with the safety technologies shall be responsible for, and features set out in paragraph 1. be able to demonstrate, compliance with the safety features set out in paragraph 1.

AM\1206345EN.docx 71/117 PE652.548v02-00 EN Or. en

Amendment 566 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – Article 8 – paragraph 2

Motion for a resolution Amendment

2. In accordance with Article 6(2), the 2. In accordance with Article 6(2), the technologies mentioned in paragraph 1 technologies mentioned in paragraph 1 shall be developed, deployed and used in shall be developed, deployed and used in transparent and traceable manner so that transparent and traceable manner so that their elements, processes and phases are their elements, processes and phases are documented to the highest standards, and documented to the highest possible that it is possible for the national standards, and that it is possible for the supervisory authorities referred to in national supervisory authorities referred to Article 14 to assess the compliance of such in Article 14 to assess the compliance of technologies with the obligations set out in such technologies with the obligations set this Regulation. In particular, the out in this Regulation. In particular, the developer, deployer or user of those developer, deployer or user of those technologies shall be responsible for, and technologies shall be responsible for, and be able to demonstrate, compliance with be able to demonstrate, compliance with the safety features set out in paragraph 1. the safety features set out in paragraph 1.

Or. en

Amendment 567 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – Article 8 – paragraph 2

Motion for a resolution Amendment

PE652.548v02-00 72/117 AM\1206345EN.docx EN technologies with the obligations set out in technologies with the obligations set out in this Regulation. In particular, the this Regulation. In particular, the developer, deployer or user of those developer, deployer or user of those technologies shall be responsible for, and technologies shall be responsible for, and be able to demonstrate, compliance with be able to demonstrate, compliance with the safety features set out in paragraph 1. the safety features set out in paragraph 1.

Or. en

Amendment 568 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – Article 8 – paragraph 3

Motion for a resolution Amendment

3. The developer, deployer or user of 3. The developer, deployer or user of the technologies mentioned in paragraph 1 the technologies mentioned in paragraph 1 shall ensure that the measures taken to shall ensure that the measures taken to ensure compliance with the safety features ensure compliance with the features set out set out in paragraph 1 can be audited by the in paragraph 1 can be audited by the national supervisory authorities referred to competent supervisory authorities referred in Article 14. to in Article 14 and other supervisory bodies.

Or. en

Amendment 569 Stéphane Séjourné, Karen Melchior, Liesje Schreinemacher, Adrián Vázquez Lázara

Motion for a resolution Annex I – part B – Article 8 – paragraph 3

Motion for a resolution Amendment

3. The developer, deployer or user of 3. The developer, deployer or user of the technologies mentioned in paragraph high-risk technologies shall ensure that the 1 shall ensure that the measures taken to measures taken to ensure compliance with ensure compliance with the safety features the safety features set out in paragraph 1 set out in paragraph 1 can be audited by the can be audited by the national supervisory national supervisory authorities referred to authorities referred to in Article 14. in Article 14.

Or. en

AM\1206345EN.docx 73/117 PE652.548v02-00 EN Amendment 570 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – Article 8 – paragraph 4

Motion for a resolution Amendment

4. Users shall be presumed to have deleted complied with the obligations set out in this Article where their use of artificial, robotics and related technologies, including software, algorithms and data used or produced by such technologies, is carried out in good faith and in no way contravenes the ethical principles laid down in this Regulation.

Or. en

Amendment 571 Stéphane Séjourné, Karen Melchior, Liesje Schreinemacher, Adrián Vázquez Lázara

Motion for a resolution Annex I – part B – Article 8 – paragraph 4

Motion for a resolution Amendment

4. Users shall be presumed to have 4. Users shall be presumed to have complied with the obligations set out in complied with the obligations set out in this Article where their use of artificial, this Article. robotics and related technologies, including software, algorithms and data used or produced by such technologies, is carried out in good faith and in no way contravenes the ethical principles laid down in this Regulation.

Or. en

Amendment 572 Geoffroy Didier, Andrzej Halicki, Axel Voss

PE652.548v02-00 74/117 AM\1206345EN.docx EN Motion for a resolution Annex I – part B – Article 8 – paragraph 4

Motion for a resolution Amendment

4. Users shall be presumed to have 4. Users shall be presumed to have complied with the obligations set out in complied with the obligations set out in this Article where their use of artificial, this Article where their use of artificial, robotics and related technologies, including robotics and related technologies, including software, algorithms and data used or software, algorithms and data used or produced by such technologies, is carried produced by such technologies, is carried out in good faith and in no way out in good faith in accordance with the contravenes the ethical principles laid safety and use instructions provided by down in this Regulation. the developed and/or the deployer and in no way contravening the ethical principles laid down in this Regulation.

Or. en

Amendment 573 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – Article 9 – paragraph 1

Motion for a resolution Amendment

1. Any software, algorithm or data 1. Any high-risk software, algorithm used or produced by artificial intelligence, or data used or produced by artificial robotics and related technologies intelligence, robotics and related developed, deployed or used in the Union technologies developed, deployed or used shall be such as to ensure respect for in the Union shall be such as to ensure human dignity and equal treatment for all. respect for human dignity and equal treatment for all in line with Union law.

Or. en

Amendment 574 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – Article 9 – paragraph 1

AM\1206345EN.docx 75/117 PE652.548v02-00 EN Motion for a resolution Amendment

1. Any software, algorithm or data 1. Any software, algorithm or data used or produced by artificial intelligence, used or produced by artificial intelligence, robotics and related technologies robotics and related technologies developed, deployed or used in the Union developed, deployed or used in the Union shall be such as to ensure respect for shall be such as to ensure respect for human dignity and equal treatment for all. human rights and dignity and equal treatment for all.

Or. en

Amendment 575 Stéphane Séjourné, Karen Melchior, Liesje Schreinemacher, Adrián Vázquez Lázara

Motion for a resolution Annex I – part B – Article 9 – paragraph 1

Motion for a resolution Amendment

1. Any software, algorithm or data 1. High-risk technologies, including used or produced by artificial intelligence, software, algorithm or data used or robotics and related technologies produced by such technologies developed, developed, deployed or used in the Union deployed or used in the Union shall be shall be such as to ensure respect for such as to ensure respect for human dignity human dignity and equal treatment for all. and equal treatment for all.

Or. en

Amendment 576 Raffaele Stancanelli

Motion for a resolution Annex I – part B – Article 9 – paragraph 2

Motion for a resolution Amendment

PE652.548v02-00 76/117 AM\1206345EN.docx EN orientation, pregnancy, disability, physical orientation, pregnancy, disability, physical or genetic features, age, national minority, or genetic features, age, national minority, ethnic or social origin, language, religion ethnic or social origin, language, religion or belief, political views or civic or belief, political views or civic participation, citizenship, civil or economic participation, citizenship, civil or economic status, education, or criminal record. status, education, or criminal record, and shall not seek to promote certain ideas, values and uniform views of society.

Or. it

Amendment 577 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – Article 9 – paragraph 2

Motion for a resolution Amendment

2. Any software, algorithm or data 2. Any high-risk software, algorithm used or produced by artificial intelligence, or data used or produced by artificial robotics and related technologies intelligence, robotics and related developed, deployed or used in the Union technologies developed, deployed or used shall be unbiased and, without prejudice to in the Union shall be unbiased and, without paragraph 3, shall not discriminate on prejudice to paragraph 3, shall not grounds such as race, gender, sexual discriminate on grounds such as race, orientation, pregnancy, disability, physical gender, sexual orientation, pregnancy, or genetic features, age, national minority, disability, physical or genetic features, age, ethnic or social origin, language, religion national minority, ethnic or social origin, or belief, political views or civic language, religion or belief, political views participation, citizenship, civil or economic or civic participation, citizenship, civil or status, education, or criminal record. economic status, education, or criminal record.

Or. en

Amendment 578 Stéphane Séjourné, Karen Melchior, Liesje Schreinemacher, Adrián Vázquez Lázara

Motion for a resolution Annex I – part B – Article 9 – paragraph 2

Motion for a resolution Amendment

2. Any software, algorithm or data 2. High-risk technologies, including

AM\1206345EN.docx 77/117 PE652.548v02-00 EN used or produced by artificial intelligence, software, algorithms and data used or robotics and related technologies produced by such technologies, developed, developed, deployed or used in the Union deployed or used in the Union shall be shall be unbiased and, without prejudice to unbiased and, without prejudice to paragraph 3, shall not discriminate on paragraph 3,shall not discriminate on grounds such as race, gender, sexual grounds such as race, gender, sexual orientation, pregnancy, disability, physical orientation, pregnancy, disability, physical or genetic features, age, national minority, or genetic features, age, national minority, ethnic or social origin, language, religion ethnic or social origin, language, religion or belief, political views or civic or belief, political views or civic participation, citizenship, civil or economic participation, citizenship, civil or economic status, education, or criminal record. status, education, or criminal record.

Or. en

Amendment 579 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – Article 9 – paragraph 2

Motion for a resolution Amendment

2. Any software, algorithm or data 2. Any software, algorithm or data used or produced by artificial intelligence, used or produced by artificial intelligence, robotics and related technologies robotics and related technologies developed, deployed or used in the Union developed, deployed or used in the Union shall be unbiased and, without prejudice to shall be unbiased and shall not discriminate paragraph 3, shall not discriminate on on grounds such as perceived ethnicity, grounds such as race, gender, sexual gender, sexual orientation, pregnancy, orientation, pregnancy, disability, physical disability, physical or genetic features, age, or genetic features, age, national minority, national minority, ethnic or social origin, ethnic or social origin, language, religion language, religion or belief, political views or belief, political views or civic or civic participation, citizenship, civil or participation, citizenship, civil or economic economic status, education, or criminal status, education, or criminal record. record.

Or. en

Amendment 580 Stéphane Séjourné, Karen Melchior, Liesje Schreinemacher, Adrián Vázquez Lázara

Motion for a resolution Annex I – part B – Article 10 – paragraph 1

PE652.548v02-00 78/117 AM\1206345EN.docx EN Motion for a resolution Amendment

1. Any artificial intelligence, robotics 1. High-risk technologies ,including and related technologies, including software, algorithms and data used or software, algorithms and data used or produced by such technologies, shall be produced by such technologies, shall be developed, deployed and used in the Union developed, deployed and used in the Union in compliance with the relevant Union law, in compliance with the relevant Union law, principles and values.. principles and values, in a manner that ensures optimal social, environmental and economic outcomes and that does not result in injury or harm of any kind to being caused to individuals or society.

Or. en

Amendment 581 Raffaele Stancanelli

Motion for a resolution Annex I – part B – Article 10 – paragraph 1

Motion for a resolution Amendment

1. Any artificial intelligence, robotics 1. Any artificial intelligence, robotics and related technologies, including and related technologies, including software, algorithms and data used or software, algorithms and data used or produced by such technologies, shall be produced by such technologies, shall be developed, deployed and used in the Union developed, deployed and used in the Union in compliance with the relevant Union law, in compliance with the relevant Union law, principles and values, in a manner that principles and values, in a manner that ensures optimal social, environmental and ensures optimal social, environmental and economic outcomes and that does not economic outcomes and that does not result in injury or harm of any kind to result in injury or harm of any kind to being caused to individuals or society. being caused to individuals or society, paying particular attention to the possible adverse effects on employment and workers’ rights.

Or. it

Amendment 582 Geoffroy Didier, Andrzej Halicki, Axel Voss

AM\1206345EN.docx 79/117 PE652.548v02-00 EN Motion for a resolution Annex I – part B – Article 10 – paragraph 1

Motion for a resolution Amendment

1. Any artificial intelligence, robotics 1. Any high-risk artificial and related technologies, including intelligence, robotics and related software, algorithms and data used or technologies, including software, produced by such technologies, shall be algorithms and data used or produced by developed, deployed and used in the Union such technologies, shall be developed, in compliance with the relevant Union deployed and used in the Union in a law, principles and values, in a manner socially responsible manner that ensures that ensures optimal social, environmental social well-being, environmental and and economic outcomes and that does not economic outcomes that contributes to result in injury or harm of any kind to gender balance and that does not result in being caused to individuals or society. injury or harm of any kind to being caused to individuals or society in compliance with relevant Union laws, principles and values.

Or. en

Amendment 583 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – Article 10 – paragraph 2

Motion for a resolution Amendment

2. Any artificial intelligence, robotics deleted and related technologies, including software, algorithms and data used or produced by such technologies, developed, deployed or used in the Union shall be developed, deployed and used in a socially responsible manner. In particular, such a manner shall mean that such technologies are: (a) developed, deployed and used in a manner that contributes to improving individual development, collective well- being and the healthy functioning of democracy, without interfering in political processes, decision-making and elections or contributing to the dissemination of

PE652.548v02-00 80/117 AM\1206345EN.docx EN disinformation; (b) developed, deployed and used in a manner that contributes to the achievement of a fair society by helping to increase citizens’ health and well-being, fostering equality in the creation and availability of economic, social and political opportunity and respecting workers’ rights; (c) developed, deployed and used in a manner that contributes to public debate, complements and empowers human cognitive skills, encourages quality education and promotes multilingualism while reflecting the cultural diversity of the Union; (d) developed, deployed and used in a gender-balanced manner that narrows the gender gap by providing equal opportunities for all; (e) developed, deployed and used in a manner that contributes to the narrowing of the digital divide among regions, age groups and social classes, the promotion of digital literacy and skills, innovation and creativity, while respecting intellectual property rights;

Or. en

Amendment 584 Stéphane Séjourné, Liesje Schreinemacher, Karen Melchior, Adrián Vázquez Lázara

Motion for a resolution Annex I – part B – Article 10 – paragraph 2 – introductory part

Motion for a resolution Amendment

2. Any artificial intelligence, robotics 2. High-risk technologies, including and related technologies, including software, algorithms and data used or software, algorithms and data used or produced by such technologies, developed, produced by such technologies, developed, deployed or used in the Union shall be deployed or used in the Union shall be developed, deployed and used in a socially developed, deployed and used in a socially responsible manner. responsible manner. In particular, such a

AM\1206345EN.docx 81/117 PE652.548v02-00 EN manner shall mean that such technologies are:

Or. en

Amendment 585 Stéphane Séjourné, Karen Melchior, Liesje Schreinemacher, Adrián Vázquez Lázara

Motion for a resolution Annex I – part B – Article 10 – paragraph 2 – point a

Motion for a resolution Amendment

(a) developed, deployed and used in a deleted manner that contributes to improving individual development, collective well- being and the healthy functioning of democracy, without interfering in political processes, decision-making and elections or contributing to the dissemination of disinformation;

Or. en

Amendment 586 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – Article 10 – paragraph 2 – point a

Motion for a resolution Amendment

Or. en

PE652.548v02-00 82/117 AM\1206345EN.docx EN Amendment 587 Stéphane Séjourné, Karen Melchior, Liesje Schreinemacher, Adrián Vázquez Lázara

Motion for a resolution Annex I – part B – Article 10 – paragraph 2 – point b

Motion for a resolution Amendment

(b) developed, deployed and used in a deleted manner that contributes to the achievement of a fair society by helping to increase citizens’ health and well-being, fostering equality in the creation and availability of economic, social and political opportunity and respecting workers’ rights;

Or. en

Amendment 588 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – Article 10 – paragraph 2 – point b

Motion for a resolution Amendment

Or. en

Amendment 589 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – Article 10 – paragraph 2 – point c

AM\1206345EN.docx 83/117 PE652.548v02-00 EN Motion for a resolution Amendment

(c) developed, deployed and used in a deleted manner that contributes to public debate, complements and empowers human cognitive skills, encourages quality education and promotes multilingualism while reflecting the cultural diversity of the Union;

Or. en

Amendment 590 Stéphane Séjourné, Karen Melchior, Liesje Schreinemacher, Adrián Vázquez Lázara

Motion for a resolution Annex I – part B – Article 10 – paragraph 2 – point c

Motion for a resolution Amendment

Or. en

Amendment 591 Raffaele Stancanelli

Motion for a resolution Annex I – part B – Article 10 – paragraph 2 – point c

Motion for a resolution Amendment

(c) developed, deployed and used in a (c) developed, deployed and used in a manner that contributes to public debate, manner that contributes to public debate, complements and empowers human complements and empowers human cognitive skills, encourages quality cognitive skills, encourages quality education and promotes multilingualism education and promotes multilingualism while reflecting the cultural diversity of the while reflecting the cultural diversity of the

PE652.548v02-00 84/117 AM\1206345EN.docx EN Union; Union and promoting the traditions and customs of its peoples;

Or. it

Amendment 592 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – Article 10 – paragraph 2 – point d

Motion for a resolution Amendment

(d) developed, deployed and used in a deleted gender-balanced manner that narrows the gender gap by providing equal opportunities for all;

Or. en

Amendment 593 Stéphane Séjourné, Karen Melchior, Liesje Schreinemacher, Adrián Vázquez Lázara

Motion for a resolution Annex I – part B – Article 10 – paragraph 2 – point d

Motion for a resolution Amendment

(d) developed, deployed and used in a deleted gender-balanced manner that narrows the gender gap by providing equal opportunities for all;

Or. en

Amendment 594 Stéphane Séjourné, Karen Melchior, Liesje Schreinemacher, Adrián Vázquez Lázara

Motion for a resolution Annex I – part B – Article 10 – paragraph 2 – point e

AM\1206345EN.docx 85/117 PE652.548v02-00 EN Motion for a resolution Amendment

(e) developed, deployed and used in a deleted manner that contributes to the narrowing of the digital divide among regions, age groups and social classes, the promotion of digital literacy and skills, innovation and creativity, while respecting intellectual property rights;

Or. en

Amendment 595 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – Article 10 – paragraph 2 – point e

Motion for a resolution Amendment

Or. en

Amendment 596 Ibán García Del Blanco

Motion for a resolution Annex I – part B – Article 10 – paragraph 2 – point e

Motion for a resolution Amendment

(e) developed, deployed and used in a (e) developed, deployed and used in a manner that contributes to the narrowing of manner that contributes to the narrowing of the digital divide among regions, age the digital divide among regions, age groups and social classes, the promotion of groups and social classes, the promotion of digital literacy and skills, innovation and digital literacy and skills, innovation and creativity, while respecting intellectual creativity, while respecting intellectual

PE652.548v02-00 86/117 AM\1206345EN.docx EN property rights; property rights and exploring the potential of these technologies, namely through their explainability, in detecting infringements of such rights;

Or. en

Amendment 597 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – Article 10 – paragraph 2 – point e

Motion for a resolution Amendment

Or. en

Amendment 598 Caterina Chinnici

Motion for a resolution Annex I – part B – Article 10 – paragraph 2 – point e

Motion for a resolution Amendment

(e) developed, deployed and used in a (e) developed, deployed and used in a manner that contributes to the narrowing of manner that contributes to the narrowing of the digital divide among regions, age the digital divide among regions, age groups and social classes, the promotion of groups and social classes, the protection of digital literacy and skills, innovation and children, the promotion of digital literacy creativity, while respecting intellectual and skills, innovation and creativity, while property rights; respecting intellectual property rights;

Or. en

AM\1206345EN.docx 87/117 PE652.548v02-00 EN Amendment 599 Stéphane Séjourné, Karen Melchior, Adrián Vázquez Lázara, Liesje Schreinemacher

Motion for a resolution Annex I – part B – Article 10 – paragraph 3

Motion for a resolution Amendment

3. The Union and its Member States deleted shall encourage research projects intended to provide solutions, based on artificial intelligence, robotics and related technologies, that seek to promote social inclusion, plurality, solidarity, fairness, equality and cooperation.

Or. en

Amendment 600 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – Article 10 – paragraph 3

Motion for a resolution Amendment

3. The Union and its Member States 3. The Union and its Member States shall encourage research projects intended shall encourage research projects intended to provide solutions, based on artificial to provide solutions, based on artificial intelligence, robotics and related intelligence, robotics and related technologies, that seek to promote social technologies, that seek to promote social inclusion, plurality, solidarity, fairness, inclusion, democracy, plurality, solidarity, equality and cooperation. fairness, equality and cooperation.

Or. en

Amendment 601 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – Article 10 – paragraph 4

Motion for a resolution Amendment

4. The social effects of the ubiquitous deleted

PE652.548v02-00 88/117 AM\1206345EN.docx EN presence of artificial intelligence, robotics and related technologies, including software, algorithms and data used or produced by such technologies, developed, deployed or used in the Union shall be monitored by the national supervisory authorities referred to in Article 14, in order to avoid disruptive effects on social agency and social relationships, as well as the deterioration of social skills.

Or. en

Amendment 602 Stéphane Séjourné, Karen Melchior, Liesje Schreinemacher, Adrián Vázquez Lázara

Motion for a resolution Annex I – part B – Article 10 – paragraph 4

Motion for a resolution Amendment

4. The social effects of the ubiquitous deleted presence of artificial intelligence, robotics and related technologies, including software, algorithms and data used or produced by such technologies, developed, deployed or used in the Union shall be monitored by the national supervisory authorities referred to in Article 14, in order to avoid disruptive effects on social agency and social relationships, as well as the deterioration of social skills.

Or. en

Amendment 603 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – Article 10 – paragraph 4

Motion for a resolution Amendment

4. The social effects of the ubiquitous 4. The social effects of the ubiquitous presence of artificial intelligence, robotics presence of artificial intelligence, robotics

AM\1206345EN.docx 89/117 PE652.548v02-00 EN and related technologies, including and related technologies, including software, algorithms and data used or software, algorithms and data used or produced by such technologies, developed, produced by such technologies, developed, deployed or used in the Union shall be deployed or used in the Union shall be monitored by the national supervisory monitored by the competent supervisory authorities referred to in Article 14, in authorities referred to in Article 14 and order to avoid disruptive effects on social other supervisory bodies, in order to avoid agency and social relationships, as well as disruptive effects on social agency and the deterioration of social skills. social relationships, as well as the deterioration of social skills.

Or. en

Amendment 604 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – Article 11 – title

Motion for a resolution Amendment

Environmental friendliness and Environmental sustainability sustainability

Or. en

Amendment 605 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – Article 11 – paragraph 1

Motion for a resolution Amendment

1. Any artificial intelligence, robotics 1. Any artificial intelligence, robotics and related technologies, including and related technologies, including software, algorithms and data used or software, algorithms and data used or produced by such technologies, shall be produced by such technologies, shall be developed, deployed or used in the Union developed, deployed or used in the Union in compliance with Union law, principles in compliance with Union law, principles and values, in a manner that ensures and values, in a manner that preserves the optimal environmentally friendly environment, minimises and remedies outcomes and minimises their their environmental footprint during their environmental footprint during their lifecycle and through their entire supply lifecycle and through their entire supply chain, in order to contribute to the green

PE652.548v02-00 90/117 AM\1206345EN.docx EN chain, in order to support the achievement transition, support the achievement of of climate neutrality and circular economy climate neutrality and circular economy goals. goals.

Or. en

Amendment 606 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – Article 11 – paragraph 1

Motion for a resolution Amendment

1. Any artificial intelligence, robotics 1. Any high-risk artificial and related technologies, including intelligence, robotics and related software, algorithms and data used or technologies, including software, produced by such technologies, shall be algorithms and data used or produced by developed, deployed or used in the Union such technologies, shall be developed, in compliance with Union law, principles deployed or used in the Union in a manner and values, in a manner that ensures that ensures environmentally sustainable optimal environmentally friendly outcomes outcomes and minimises their and minimises their environmental environmental footprint during their footprint during their lifecycle and through lifecycle and through their entire supply their entire supply chain, in order to chain, in order to support the achievement support the achievement of climate of climate neutrality and circular economy neutrality and circular economy goals. goals in accordance with the applicable Union law.

Or. en

Amendment 607 Stéphane Séjourné, Karen Melchior, Liesje Schreinemacher, Adrián Vázquez Lázara

Motion for a resolution Annex I – part B – Article 11 – paragraph 1

Motion for a resolution Amendment

AM\1206345EN.docx 91/117 PE652.548v02-00 EN and values, in a manner that ensures the environment and where applicable optimal environmentally friendly they shall pursue the objective of outcomes and minimises their minimising their environmental footprint environmental footprint during their during their lifecycle and through their lifecycle and through their entire supply entire supply chain, in order to support the chain, in order to support the achievement achievement of climate neutrality and of climate neutrality and circular economy circular economy goals. goals.

Or. en

Amendment 608 Stéphane Séjourné, Adrián Vázquez Lázara

Motion for a resolution Annex I – part B – Article 11 – paragraph 2

Motion for a resolution Amendment

2. The Union and its Member States deleted shall encourage and promote research projects intended to provide solutions, based on artificial intelligence, robotics and related technologies, seeking to address environmental issues such as waste production, the carbon footprint, climate change and environmental degradation.

Or. en

Amendment 609 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – Article 11 – paragraph 2

Motion for a resolution Amendment

2. The Union and its Member States 2. The Union and its Member States shall encourage and promote research shall encourage and promote research projects intended to provide solutions, projects intended to provide solutions, based on artificial intelligence, robotics based on artificial intelligence, robotics and related technologies, seeking to and related technologies, seeking to address environmental issues such as waste remedy environmental issues such as waste

PE652.548v02-00 92/117 AM\1206345EN.docx EN production, the carbon footprint, climate production, the carbon footprint, climate change and environmental degradation. change and environmental degradation.

Or. en

Amendment 610 Stéphane Séjourné, Karen Melchior, Liesje Schreinemacher, Adrián Vázquez Lázara

Motion for a resolution Annex I – part B – Article 11 – paragraph 3

Motion for a resolution Amendment

3. Any artificial intelligence, robotics deleted and related technologies, including software, algorithms and data used or produced by such technologies, shall be assessed as to their environmental friendliness and sustainability by the national supervisory authorities, referred to in Article 14, ensuring that measures are put in place to mitigate their general impact as regards natural resources, energy consumption, waste production, the carbon footprint, climate change and environmental degradation.

Or. en

Amendment 611 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – Article 11 – paragraph 3

Motion for a resolution Amendment

3. Any artificial intelligence, robotics 3. Any high-risk artificial and related technologies, including intelligence, robotics and related software, algorithms and data used or technologies, including software, produced by such technologies, shall be algorithms and data used or produced by assessed as to their environmental such technologies, shall be assessed as to friendliness and sustainability by the their environmental sustainability by the national supervisory authorities, referred to national supervisory authorities, referred to in Article 14, ensuring that measures are in Article 14, ensuring that measures are

AM\1206345EN.docx 93/117 PE652.548v02-00 EN put in place to mitigate their general impact put in place to mitigate their general impact as regards natural resources, energy as regards natural resources, energy consumption, waste production, the carbon consumption, waste production, the carbon footprint, climate change and footprint, climate change and environmental degradation. environmental degradation in order to ensure compliance with the applicable Union or national law.

Or. en

Amendment 612 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – Article 11 – paragraph 3

Motion for a resolution Amendment

3. Any artificial intelligence, robotics 3. Any artificial intelligence, robotics and related technologies, including and related technologies, including software, algorithms and data used or software, algorithms and data used or produced by such technologies, shall be produced by such technologies, shall be assessed as to their environmental assessed as to their environmental friendliness and sustainability by the friendliness and sustainability by the national supervisory authorities, referred competent supervisory authorities, referred to in Article 14, ensuring that measures are to in Article 14 and other supervisory put in place to mitigate their general impact bodies, ensuring that measures are put in as regards natural resources, energy place to mitigate their general impact as consumption, waste production, the carbon regards natural resources, energy footprint, climate change and consumption, waste production, the carbon environmental degradation. footprint, climate emergency and environmental degradation.

Or. en

Amendment 613 Stéphane Séjourné, Karen Melchior, Liesje Schreinemacher, Adrián Vázquez Lázara

Motion for a resolution Annex I – part B – Article 11 a (new)

Motion for a resolution Amendment

Article 11a

PE652.548v02-00 94/117 AM\1206345EN.docx EN Compliance assessment 1. The national supervisory authorities referred to in Article 14 shall assess whether high-risk technologies are compliant with the obligations set out in Chapter II of this Regulation. 2. The software, algorithms and data used or produced by high-risk technologies which have been assessed compliant within the meaning of this article shall be presumed compliant with this Regulation, unless the national supervisory authority decides to conduct an assessment at its own initiative or at the request of the developer, the deployer or the user. 3. When assessing the compliance with the obligations specified under Articles 9, 10 and 11, the national authority shall in particular consider the purposes pursued by the development, the deployment or the use the technologies, especially when it relates to: (a) individual development, collective well-being, democracy and political processes; (b) health and workers’ rights; (c) education. 4. The Commission shall prepare binding guidelines, in accordance with the applicable sectorial legislation, on the methodology to be used by the national supervisory authorities for the compliance assessment by the date of the entry into force of this Regulation.

Or. en

Amendment 614 Stéphane Séjourné, Karen Melchior, Liesje Schreinemacher, Adrián Vázquez Lázara

Motion for a resolution Annex I – part B – Article 11 b (new)

AM\1206345EN.docx 95/117 PE652.548v02-00 EN Motion for a resolution Amendment

Article 11b Implementation guidance The Commission shall prepare non- binding guidelines on the methodology for compliance with this Regulation intended to developers, deployers and users. In doing so, the Commission shall consult relevant stakeholders. The Commission shall publish the guidelines by the date of the entry into force of this Regulation.

Or. en

Amendment 615 Sergey Lagodinsky, Alexandra Geese, Patrick Breyer

Motion for a resolution Annex I – part B – Article 12 – title

Motion for a resolution Amendment

Privacy and biometric recognition Privacy

Or. en

Amendment 616 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – Article 12 – paragraph 1 a (new)

Motion for a resolution Amendment

1a. The use and gathering of biometric data for remote identification purposes for deployment of facial recognition in public area, carries specific risk for fundamental rights and shall be limited only to substantial public interest in accordance with EU data protection

PE652.548v02-00 96/117 AM\1206345EN.docx EN rules and, in particular, the GDPR. In that case, the processing must take place on the basis of Union or national law, subject to the requirements of proportionality, respect for the essence of the right to data protection and appropriate safeguards and in compliance with Article 12(1).

Or. en

Amendment 617 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – Article 12 – paragraph 2

Motion for a resolution Amendment

2. In accordance with Article 5(2), deleted where remote recognition technologies, such as biometric recognition, are deployed or used by Member States’ public authorities for the purpose of responding to a national emergency, those authorities shall ensure that such deployment or use is limited to specific objectives, restricted in time and carried out with due regard for human dignity and the fundamental rights set out in the Charter.

Or. en

Amendment 618 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – Article 12 – paragraph 2

Motion for a resolution Amendment

AM\1206345EN.docx 97/117 PE652.548v02-00 EN or used by Member States’ public or used by Member States’ public authorities for the purpose of responding authorities, they shall ensure that such to a national emergency, those authorities deployment or use is voluntary, shall ensure that such deployment or use is proportionate, targeted and limited to limited to specific objectives, restricted in specific objectives, restricted in time and time and carried out with due regard for carried out in accordance with Union law, human dignity and the fundamental rights with due regard for human rights and set out in the Charter. dignity, autonomy and self-determination of the individual and the fundamental rights set out in the Charter. Criteria for and limits to their use should be subjected to judicial review and submitted to democratic scrutiny and debate involving civil society, in order to determine whether, when and how it should take place, and such use should be mindful of its psychological and sociocultural impact.

Or. en

Amendment 619 Emmanuel Maurel, Manon Aubry

Motion for a resolution Annex I – part B – Article 12 – point 2

Motion for a resolution Amendment

2. In accordance with Article 5(2), 2. In accordance with Article 5(2), where remote recognition technologies, where remote recognition technologies, such as biometric recognition, are deployed such as biometric recognition, are deployed or used by Member States’ public or used by Member States’ public authorities for the purpose of responding to authorities for the purpose of responding to a national emergency, those authorities a national emergency, those authorities shall ensure that such deployment or use is shall ensure that such deployment or use is limited to specific objectives, restricted in limited to specific objectives and locations time and carried out with due regard for (some establishments might be visited by human dignity and the fundamental rights the public and pose, by their nature, a set out in the Charter. high security risk to individuals and to the State), restricted in time and carried out with due regard for human dignity and the fundamental rights set out in the Charter.

Or. fr

PE652.548v02-00 98/117 AM\1206345EN.docx EN Amendment 620 Stéphane Séjourné, Karen Melchior, Adrián Vázquez Lázara, Liesje Schreinemacher

Motion for a resolution Annex I – part B –After Article 12 – chapter title (new)

Motion for a resolution Amendment

Chapter III: Specific requirements

Or. en

Amendment 621 Stéphane Séjourné, Liesje Schreinemacher

Motion for a resolution Article 12 a (new)

Motion for a resolution Amendment

Article 12a Public power decisions 1. Member States shall conduct an impact assessment on fundamental rights for high-risk technologies used within their prerogatives of public powers that have a significant and direct impact on the rights and obligations of natural or legal persons. 2. High-risk technologies that have a direct and significant impact on rights and obligations of natural and legal persons shall be subject to strict human verification, and due process.

Or. en

Amendment 622 Stéphane Séjourné, Karen Melchior, Adrián Vázquez Lázara, Liesje Schreinemacher

Motion for a resolution Annex I – part B – Article 12 b (new)

AM\1206345EN.docx 99/117 PE652.548v02-00 EN Motion for a resolution Amendment

Article 12b Right to redress 1. Any natural or legal person shall be able to seek redress for damages caused by a decision issued at her/his detriment by high-risk technologies.

Or. en

Amendment 623 Stéphane Séjourné, Liesje Schreinemacher, Adrián Vázquez Lázara, Karen Melchior

Motion for a resolution Annex I – part B –After Article 12 b – chapter title (new)

Motion for a resolution Amendment

Chapter IV: Institutional oversight

Or. en

Amendment 624 Stéphane Séjourné

Motion for a resolution Annex I – part B – Article 13 – paragraph 1

Motion for a resolution Amendment

1. Artificial intelligence, robotics and deleted related technologies developed, deployed or used in the Union shall comply with relevant governance standards established by the national supervisory authorities referred to in Article 14 in accordance with Union law, principles and values.

Or. en

PE652.548v02-00 100/117 AM\1206345EN.docx EN Amendment 625 Evelyne Gebhardt, Brando Benifei, Bettina Vollath

Motion for a resolution Annex I – part B – Article 13 – paragraph 1

Motion for a resolution Amendment

1. Artificial intelligence, robotics and 1. Artificial intelligence, robotics and related technologies developed, deployed related technologies developed, deployed or used in the Union shall comply with or used in the Union shall comply with relevant governance standards established relevant governance standards drafted by by the national supervisory authorities the European Commission or another referred to in Article 14 in accordance with relevant institution, body, office or agency Union law, principles and values. of the Union designated for this task and implemented by the national supervisory authorities referred to in Article 14 in accordance with Union law, principles and values.

Or. en

Amendment 626 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – Article 13 – paragraph 1

Motion for a resolution Amendment

1. Artificial intelligence, robotics and 1. Artificial intelligence, robotics and related technologies developed, deployed related technologies developed, deployed or used in the Union shall comply with or used in the Union shall comply with relevant governance standards established relevant governance standards established by the national supervisory authorities by the competent supervisory authorities referred to in Article 14 in accordance with referred to in Article 14 and further Union law, principles and values. supervisory bodies, in accordance with Union law, principles and values.

Or. en

Amendment 627 Sergey Lagodinsky, Alexandra Geese

AM\1206345EN.docx 101/117 PE652.548v02-00 EN Motion for a resolution Annex I – part B – Article 13 – paragraph 2

Motion for a resolution Amendment

2. Data used or produced by artificial 2. Data produced or destined to be intelligence, robotics and related used by artificial intelligence, robotics and technologies developed, deployed or used related technologies developed, deployed in the Union shall be managed by or used in the Union shall be managed by developers, deployers and users in developers, deployers and users in accordance with relevant standards referred accordance with relevant standards referred to in paragraph 1, as well as with relevant to in paragraph 1, as well as with relevant industry and business protocols. In industry and business protocols. In particular, developers and deployers shall particular, developers and deployers shall carry out, where feasible, quality checks of carry out, where feasible, quality checks of the external sources of data used by the external sources of data used by artificial intelligence, robotics and related artificial intelligence, robotics and related technologies, and shall put oversight technologies, and shall put oversight mechanisms in place regarding their mechanisms in place regarding their collection, storage, processing and use. collection, storage, processing and use.

Or. en

Amendment 628 Stéphane Séjourné, Karen Melchior, Liesje Schreinemacher, Adrián Vázquez Lázara

Motion for a resolution Annex I – part B – Article 13 – paragraph 2

Motion for a resolution Amendment

2. Data used or produced by artificial 2. Data used or produced by high-risk intelligence, robotics and related technologies developed, deployed or used technologies developed, deployed or used in the Union shall be managed by in the Union shall be managed by developers, deployers and users in developers, deployers and users in accordance with the relevant national, accordance with relevant standards European and international rules, as well referred to in paragraph 1, as well as with as with relevant industry and business relevant industry and business protocols. In protocols. In particular, developers and particular, developers and deployers shall deployers shall carry out, where feasible, carry out, where feasible, quality checks of quality checks of the external sources of the external sources of data used by data used by artificial intelligence, robotics artificial intelligence, robotics and related and related technologies, and shall put technologies, and shall put oversight oversight mechanisms in place regarding mechanisms in place regarding their their collection, storage, processing and collection, storage, processing and use. use.

PE652.548v02-00 102/117 AM\1206345EN.docx EN Or. en

Amendment 629 Stéphane Séjourné, Karen Melchior, Liesje Schreinemacher, Adrián Vázquez Lázara

Motion for a resolution Annex I – part B – Article 13 – paragraph 3

Motion for a resolution Amendment

3. Without prejudice to portability 3. Without prejudice to portability rights and rights of persons whose usage of rights and rights of persons whose usage of artificial intelligence, robotics and related high-risk technologies has generated data, technologies has generated data, the the collection, storage, processing, sharing collection, storage, processing, sharing of of and access to data used or produced by and access to data used or produced by artificial intelligence, robotics and related artificial intelligence, robotics and related technologies developed, deployed or used technologies developed, deployed or used in the Union shall comply with the relevant in the Union shall comply with the relevant national, European and international standards referred to in paragraph 1, as rules, as well as with relevant industry and well as with relevant industry and business business protocols. In particular, protocols. In particular, developers and developers and deployers shall ensure deployers shall ensure those protocols are those protocols are applied during the applied during the development and development and deployment of high-risk deployment of artificial intelligence, technologies, by clearly defining the robotics and related technologies, by requirements for processing and granting clearly defining the requirements for access to data used or produced by these processing and granting access to data used technologies, as well as the purpose, scope or produced by these technologies, as well and addressees of the processing and the as the purpose, scope and addressees of the granting of access to such data, all of processing and the granting of access to which shall at all times be auditable and such data, all of which shall at all times be traceable. auditable and traceable.

Or. en

Amendment 630 Marion Walsmann

Motion for a resolution Annex I – part B – Article 13 a (new)

Motion for a resolution Amendment

Article 13a

AM\1206345EN.docx 103/117 PE652.548v02-00 EN Guidelines The Commission is drawing up guidelines for the application of this Regulation, in particular to enable small and medium- sized enterprises to effectively comply with the requirements of Articles 9 to 13 of this Regulation while minimising administrative and other burdens.

Or. de

Amendment 631 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – Article 14 – paragraph 1

Motion for a resolution Amendment

1. Each Member State shall designate 1. Each Member State shall designate an independent public authority to be an independent public authority to be responsible for monitoring the application responsible for monitoring the application of this Regulation (‘supervisory of this Regulation (‘supervisory authority’). In accordance with Article 7(1) authority’). In accordance with Article 7, and (2), each national supervisory each national supervisory authority shall be authority shall be responsible for assessing responsible for assessing and monitoring whether artificial intelligence, robotics their compliance with the ethical principles and related technologies, including set out in this Regulation. software, algorithms and data used or produced by such technologies, developed, deployed and used in the Union are high- risk technologies and, if so, for assessing and monitoring their compliance with the ethical principles set out in this Regulation.

Or. en

Amendment 632 Stéphane Séjourné, Karen Melchior, Adrián Vázquez Lázara, Liesje Schreinemacher

Motion for a resolution Annex I – part B – Article 14 – paragraph 1

PE652.548v02-00 104/117 AM\1206345EN.docx EN Motion for a resolution Amendment

1. Each Member State shall designate 1. Each Member State shall designate an independent public authority to be an independent public authority to be responsible for monitoring the application responsible for monitoring the application of this Regulation (‘supervisory of this Regulation (‘supervisory authority’). In accordance with Article 7(1) authority’). In accordance with Article (2), and (2), each national supervisory each national supervisory authority shall be authority shall be responsible for assessing responsible for assessing and monitoring whether artificial intelligence, robotics the compliance of high risk technologies and related technologies, including with the ethical principles set out in this software, algorithms and data used or Regulation. produced by such technologies, developed, deployed and used in the Union are high- risk technologies and, if so, for assessing and monitoring their compliance with the ethical principles set out in this Regulation.

Or. en

Amendment 633 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – Article 14 – paragraph 1

Motion for a resolution Amendment

1. Each Member State shall designate 1. Each Member State shall designate an independent public authority to be independent public authorities or responsible for monitoring the application authorities with a public purpose to be of this Regulation (‘supervisory responsible for monitoring the application authority’). In accordance with Article of this Regulation. In accordance with 7(1) and (2), each national supervisory Article 7(1) and (2), each competent authority shall be responsible for assessing supervisory authority shall be responsible whether artificial intelligence, robotics and for assessing whether artificial intelligence, related technologies, including software, robotics and related technologies, including algorithms and data used or produced by software, algorithms and data produced or such technologies, developed, deployed destined to be used by such technologies, and used in the Union are high-risk developed, deployed and used in the Union technologies and, if so, for assessing and are high-risk technologies and, if so, for monitoring their compliance with the assessing and monitoring their compliance ethical principles set out in this Regulation. with the law and the ethical principles set out in this Regulation.

Or. en

AM\1206345EN.docx 105/117 PE652.548v02-00 EN Amendment 634 Evelyne Gebhardt, Brando Benifei, Bettina Vollath

Motion for a resolution Annex I – part B – Article 14 – paragraph 1

Motion for a resolution Amendment

1. Each Member State shall designate 1. Each Member State shall designate an independent public authority to be an independent public authority to be responsible for monitoring the application responsible for monitoring the application of this Regulation (‘supervisory of this Regulation (‘supervisory authority’). In accordance with Article 7(1) authority’). In accordance with Article 7(1) and (2), each national supervisory authority and (2), each national supervisory authority shall be responsible for assessing whether shall be responsible for assessing whether artificial intelligence, robotics and related artificial intelligence, robotics and related technologies, including software, technologies, including software, algorithms and data used or produced by algorithms and data used or produced by such technologies, developed, deployed such technologies, developed, deployed and used in the Union are high-risk and used in the Union are high-risk technologies and, if so, for assessing and technologies in view of the ethical monitoring their compliance with the principles set out in this Regulation and, if ethical principles set out in this so, for assessing and monitoring their Regulation. compliance with these principles.

Or. en

Amendment 635 Evelyne Gebhardt, Brando Benifei, Bettina Vollath

Motion for a resolution Annex I – part B – Article 14 – paragraph 1 a (new)

Motion for a resolution Amendment

1a. Each national supervisory authority shall supervise the implementation of the legislation in force and, where applicable, the enforceable sectorial regulations arising when a technology is identified as a high-risk technology in view of the ethical principles set out in this Regulation. For this purpose, the supervisory authorities shall cooperate with the sectorial

PE652.548v02-00 106/117 AM\1206345EN.docx EN authorities in charge of assessing and monitoring artificial intelligence, robotics and related technologies, including the software, algorithms and data used or produced by such technologies and enforcing their compliance in the light of sectorial legislation.

Or. en

Amendment 636 Stéphane Séjourné, Karen Melchior, Liesje Schreinemacher, Adrián Vázquez Lázara

Motion for a resolution Annex I – part B – Article 14 – paragraph 2

Motion for a resolution Amendment

2. Each national supervisory authority 2. Each national supervisory authority shall contribute to the consistent shall contribute to the consistent application of this Regulation throughout application of this Regulation throughout the Union. For that purpose, the the Union. For that purpose, the supervisory authorities in each Member supervisory authorities in each Member State shall cooperate with each other, the State shall cooperate with each other, the Commission and other relevant institutions, Commission and other relevant institutions, bodies, offices and agencies of the Union, bodies, offices and agencies of the Union. in particular as regards establishing the governance standards referred to in Article 13(1).

Or. en

Amendment 637 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – Article 14 – paragraph 2

Motion for a resolution Amendment

2. Each national supervisory authority 2. Each competent supervisory shall contribute to the consistent authority shall contribute to the consistent application of this Regulation throughout application of this Regulation throughout the Union. For that purpose, the the Union. For that purpose, the supervisory authorities in each Member supervisory authorities in each Member

AM\1206345EN.docx 107/117 PE652.548v02-00 EN State shall cooperate with each other, the State shall cooperate with each other, the Commission and other relevant institutions, Commission and other relevant institutions, bodies, offices and agencies of the Union, bodies, offices and agencies of the Union, in particular as regards establishing the in particular as regards establishing the governance standards referred to in Article governance standards referred to in Article 13(1). 13(1).

Or. en

Amendment 638 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – Article 14 – paragraph 2 a (new)

Motion for a resolution Amendment

2a. The competent supervisory authorities shall serve as a first point of contact in cases of suspected discriminating treatment or of violation of other rights as a result of use of artificial intelligence and automated decision making systems, conduct ethical evaluation of such cases in cooperation with other competent authorities in the Union, notably the Consumer Protection Cooperation Network, national consumer protection bodies and civil society; to facilitate means to individuals to meaningfully contest and remedy harm caused by such discrimination or violations.

Or. en

Amendment 639 Stéphane Séjourné

Motion for a resolution Annex I – part B – Article 14 – paragraph 3

PE652.548v02-00 108/117 AM\1206345EN.docx EN Motion for a resolution Amendment

3. Each national supervisory deleted authority shall be responsible for supervising the application of governance standards to artificial intelligence, robotics and related technologies, including by liaising with the maximum possible number of stakeholders. For that purpose, the supervisory authorities in each Member State shall provide a forum for regular exchange with stakeholders.

Or. en

Amendment 640 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – Article 14 – paragraph 3

Motion for a resolution Amendment

3. Each national supervisory authority 3. Each competent supervisory shall be responsible for supervising the authority shall be responsible for application of governance standards to supervising the application of governance artificial intelligence, robotics and related standards to artificial intelligence, robotics technologies, including by liaising with the and related technologies, including by maximum possible number of stakeholders. liaising with the maximum possible For that purpose, the supervisory number of stakeholders. For that purpose, authorities in each Member State shall the supervisory authorities in each Member provide a forum for regular exchange with State shall provide a forum for regular stakeholders. exchange and the cooperation and collaboration between stakeholders from academia, research, industry, civil society and individual experts .

Or. en

Amendment 641 Sergey Lagodinsky, Alexandra Geese

Motion for a resolution Annex I – part B – Article 14 – paragraph 4

AM\1206345EN.docx 109/117 PE652.548v02-00 EN Motion for a resolution Amendment

4. Each national supervisory authority 4. Each competent supervisory shall provide professional and authority shall provide professional and administrative guidance and support on the administrative guidance and support on the general implementation of the ethical general implementation of Union law principles set out in this Regulation, regarding artificial intelligence, robotics including to small and medium-sized and related technologies, and the ethical enterprises or start-ups. principles set out in this Regulation, including to relevant research and development, and small and medium-sized enterprises or start-ups.

Or. en

Amendment 642 Stéphane Séjourné, Karen Melchior, Liesje Schreinemacher, Adrián Vázquez Lázara

Motion for a resolution Annex I – part B – Article 14 – paragraph 4

Motion for a resolution Amendment

4. Each national supervisory authority 4. Each national supervisory authority shall provide professional and shall provide professional and administrative guidance and support on administrative guidance for the the general implementation of the ethical implementation of the harmonised ethical principles set out in this Regulation, framework set out in this Regulation, including to small and medium-sized especially to small and medium-sized enterprises or start-ups. enterprises or start-ups.

Or. en

Amendment 643 Stéphane Séjourné, Karen Melchior, Liesje Schreinemacher, Adrián Vázquez Lázara

Motion for a resolution Annex I – part B – Article 14 – paragraph 6

Motion for a resolution Amendment

6. Member States shall take all 6. Member States shall support measures necessary to ensure the relevant stakeholders and civil society, at implementation of the ethical principles both Union and national level, in their

PE652.548v02-00 110/117 AM\1206345EN.docx EN set out in this Regulation. Member States efforts to ensure a timely, ethical and well- shall support relevant stakeholders and informed response to the new opportunities civil society, at both Union and national and challenges, in particular those of a level, in their efforts to ensure a timely, cross-border nature, arising from ethical and well-informed response to the technological developments relating to new opportunities and challenges, in artificial intelligence, robotics and related particular those of a cross-border nature, technologies. arising from technological developments relating to artificial intelligence, robotics and related technologies.

Or. en

Amendment 644 Emmanuel Maurel

Motion for a resolution Annex I – part B – Article 14 – paragraph 6 a (new)

Motion for a resolution Amendment

6a. For the purpose of ensuring the application of ethical principles throughout the territory of the Union as well as a harmonised functioning of the Digital Single Market in the field of artificial intelligence, robotics and related technologies, a European Agency has been established. Together with national supervisory authorities, the Agency will develop common criteria and an application process relating to the granting of a European certificate of ethical compliance following a request by any developer, deployer or user seeking to certify the positive assessment of compliance carried out by the respective national supervisory authority;

Or. fr

Amendment 645 Geoffroy Didier, Andrzej Halicki, Axel Voss

AM\1206345EN.docx 111/117 PE652.548v02-00 EN Motion for a resolution Annex I – part B – Article 15

Motion for a resolution Amendment

Article 15 deleted Reporting of breaches and protection of reporting persons Directive (EU) 2019/19373 of the European Parliament and of the Council3 shall apply to the reporting of breaches of this Regulation and the protection of persons reporting such breaches. ______3 Directive (EU) 2019/1937 of the European Parliament and of the Council of 23 October 2019 on the protection of persons who report breaches of Union law (OJ L 305, 26.11.2019, p. 17).

Or. en

Amendment 646 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – Article 15 – paragraph 1

Motion for a resolution Amendment

Directive (EU) 2019/1937 of the deleted European Parliament and of the Council3 shall apply to the reporting of breaches of this Regulation and the protection of persons reporting such breaches. ______3 Directive (EU) 2019/1937 of the European Parliament and of the Council of 23 October 2019 on the protection of persons who report breaches of Union law (OJ L 305, 26.11.2019, p. 17).

Or. en

PE652.548v02-00 112/117 AM\1206345EN.docx EN Amendment 647 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – Article 16

Motion for a resolution Amendment

Article 16 deleted Amendment to Directive (EU) No 2019/1937 Directive (EU) No 2019/1937 is amended as follows: (1) In Article 2(1), the following point is added: ‘ ‘(xi) development, deployment and use artificial intelligence, robotics and related technologies.’ (2) In Part I of the Annex, the following point is added: ‘K. Point (a)(xi) of Article 2(1) - development, deployment and use artificial intelligence, robotics and related technologies. “(xxi) Regulation [XXX] of the European Parliament and of the Council on ethical principles for the development, deployment and use artificial intelligence, robotics and related technologies”.’

Or. en

Amendment 648 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – Article 16 – paragraph 1 – point 1

Motion for a resolution Amendment

(1) In Article 2(1), the following point deleted is added: ‘

AM\1206345EN.docx 113/117 PE652.548v02-00 EN ‘(xi) development, deployment and use artificial intelligence, robotics and related technologies.’

Or. en

Amendment 649 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – Article 16 – paragraph 1 – point 2

Motion for a resolution Amendment

(2) In Part I of the Annex, the deleted following point is added: ‘K. Point (a)(xi) of Article 2(1) - development, deployment and use artificial intelligence, robotics and related technologies. “(xxi) Regulation [XXX] of the European Parliament and of the Council on ethical principles for the development, deployment and use artificial intelligence, robotics and related technologies”.’

Or. en

Amendment 650 Emmanuel Maurel

Motion for a resolution Annex I – part B – Article 17 – paragraph 1

Motion for a resolution Amendment

The Commission shall keep under regular In conjunction with the European Agency review the development of artificial for artificial intelligence, robotics and intelligence, robotics and related related technologies, the Commission shall technologies, including the software, keep under regular review the development algorithms and data used or produced by of artificial intelligence, robotics and such technologies, and shall by [OJ: please related technologies, including the enter the date three years after entry into software, algorithms and data used or force], and every three years thereafter, produced by such technologies, and shall

PE652.548v02-00 114/117 AM\1206345EN.docx EN submit to the European Parliament, the by [OJ: please enter the date three years Council and the European Economic and after entry into force], and every three Social Committee a report on the years thereafter, submit to the European application of this Regulation, including an Parliament, the Council and the European assessment of the possible modification of Economic and Social Committee a report the scope of application of this Regulation. on the application of this Regulation, including an assessment of the possible modification of the scope of application of this Regulation.

Or. fr

Amendment 651 Stéphane Séjourné

Motion for a resolution Annex I – part B – Article 17 a (new)

Motion for a resolution Amendment

Article 17a Exercise of delegation 1. The power to adopt delegated acts is conferred on the Commission subject to the conditions laid down in this Article. 2. The power to adopt delegated acts referred to in Article 2(3) shall be conferred on the Commission for an indeterminate period of time from (date of entry into force of this Regulation). 3. The delegation of power referred to in Article 2(3) may be revoked at any time by the European Parliament or by the Council. A decision to revoke shall put an end to the delegation of the power specified in that decision. It shall take effect the day following the publication of the decision in the Official Journal of the European Union or a later date specified therein. It shall not affect the validity of any delegated act already in force. 4. Before adopting a delegated act, the Commission shall consult experts designated by each Member State in accordance with the principles laid down in the Interinstitutional Agreement of 13

AM\1206345EN.docx 115/117 PE652.548v02-00 EN April 2016 on Better Law Making. 5. As soon as it adopts a delegated act, the Commission shall notify it simultaneously to the European Parliament and to the Council. 6. A delegated act adopted pursuant to Article 2(3) shall enter into force only if no objection has been expressed either by the European Parliament or the Council within a period of three months of notification of that act to the European Parliament and the Council or, if, before the expiry of that period, the European Parliament and the Council have both informed the Commission that they will not object. That period shall be extended by three months at the initiative of the European Parliament or of the Council.

Or. en

Amendment 652 Geoffroy Didier, Andrzej Halicki, Axel Voss

Motion for a resolution Annex I – part B – Annex (new)

Motion for a resolution Amendment

ANNEX The two limbed-test to determine if an AI application is ‘high-risk’ is set out as follows: the AI application is employed in a sector where significant risks can be expected to occur given the nature of activities typically undertaken (such as healthcare, transport, energy and parts of the public sector i.e. migration, social security); and the AI application is used in a manner where significant risks are likely to arise (for example, uses of AI that produce legal or other significant effects for the rights of an individual, or that pose a risk

PE652.548v02-00 116/117 AM\1206345EN.docx EN to injury death or immaterial damage).

Or. en

AM\1206345EN.docx 117/117 PE652.548v02-00 EN