Suggest modification to this talk

Title

Description

We have ethical responsibilities when coding. We're able to extract remarkably precise intuitions about an individual. But do we have a right to know what they didn't consent to share, even when they willingly shared the data that leads us there? A major retailer's data-driven marketing accidentially revealed to a teen's family that she was pregnant. Eek. What are our obligations to people who did not expect themselves to be so intimately known without sharing directly? How do we mitigate against unintended outcomes? For instance, a social network algorithm accidentally triggering painful memories for families grieving their child's death. We design software for humans. Balancing human needs and business specs can be tough. It's crucial that we learn how to build in systematic empathy. In this talk, we'll delve into specific examples of uncritical programming, and painful results from using insightful data in ways that were benignly intended. You'll learn ways we can integrate practices for examining how our code might harm individuals. We'll look at how to flip the paradigm, netting consequences that can be better for everyone.

Help us caption & translate this video!

http://amara.org/v/H4Oc/

Date

Summarized using AI?

If this talk's summary was generated by AI, please check this box. A "Summarized using AI" badge will be displayed in the summary tab to indicate that the summary was generated using AI.

Show "Summarized using AI" badge on summary page

Summary

Markdown supported

In the talk "Consequences of an Insightful Algorithm," Carina C. Zona discusses the ethical responsibilities that come with the creation of algorithms, particularly how these algorithms can lead to unintended and often harmful consequences for individuals. Zona emphasizes the importance of consent and the ethical implications of extracting personal insights from data that users have willingly shared.

Key points in the talk include:  
- **Definition and Understanding of Algorithms**: Zona begins by illustrating what algorithms are—step-by-step procedures that arrive at outcomes. She presents deep learning as a contemporary approach in this space, explaining how it extracts insights from large datasets and its application in various fields, including behavioral predictions and image classification.  
- **Unintended Consequences**: She provides three vivid case studies, such as Target’s pregnancy prediction algorithm, which accidentally revealed a teenager’s pregnancy to her father, demonstrating how insightful algorithms can lead to painful scenarios. Another instance discussed is Facebook's year-in-review feature becoming painful for a father grieving his daughter, highlighting what Zona refers to as “inadvertent algorithmic cruelty.”  
- **The Importance of Context and Sensitivity**: The necessity for developers to be sensitive to the diverse emotions and contexts of users is emphasized. For instance, Shutterfly's congratulatory messages to users who may be experiencing infertility or loss exemplify insensitivity. Zona urges programmers to adopt humility and consider the emotional ramifications of their coding decisions.  
- **Bias and Discrimination**: Zona discusses how algorithms can reinforce systemic biases within society, exemplifying this through the disparities observed in Google AdWords and racial profiling results. She discusses how data collection and interpretation can reflect existing prejudices if not critically examined.  
- **Ethical Guidelines and Practices**: The talk concludes with recommendations for developers, emphasizing the need for audits on algorithms for bias, the importance of diverse teams to avoid echo chambers, and advocating for transparency in data collection and decision-making processes. Zona calls for a paradigm shift towards integrating empathy into software design, asking developers to be proactive in questioning the ethics of their code.

In conclusion, Zona highlights that as technologists, it is crucial to approach coding responsibilities seriously, ensuring that algorithms serve humanity thoughtfully. The overarching takeaway is that technology professionals must strive to create systems that are conscious of their users' rights and intricacies of human emotion, fostering systematic empathy in coding practices.

Cancel