00:00:10.910
Everyone, thanks so much for coming to my talk. I know there are many great talks happening simultaneously, so I really appreciate your presence. This talk is titled "Lessons in Ethical Development That I Learned from Star Wars." I'm going to start right now.
00:00:21.990
I want to introduce myself. My name is Jameson, but you can call me Jamie. I'm here from Buffalo, New York, which is often regarded as the home of bad sports. I kind of thought that joke would go over better, but it's falling flat.
00:00:34.800
I'm representing a company called Girlist, which is a startup from Brooklyn that focuses on farm management and data analysis for indoor farms. I also represent a podcast called Greater Than Code. Our podcast is about tech, but more importantly, it focuses on the people behind the tech we use. I have stickers available and we're hosting a live episode panel for Greater Than Code on Thursday at 2:40, so feel free to join us.
00:00:54.870
You can find me on Twitter at Jamie Bash. Feel free to tweet me, but I ask that if you're posting about me, please remember to use they/them pronouns when referring to me.
00:01:19.110
Now that we’re all friends, the last important thing to know about me is that I love Star Wars. Here are my Star Wars credentials: that’s me in my Kylo Ren costume. I spend a lot of time thinking about Star Wars, but I also think a lot about tech and morality in technology.
00:01:37.350
These themes have been particularly important lately, especially if you've ever checked Twitter. In fact, this year's Stack Overflow developer survey asked, "Do you believe that you have an obligation to consider the ethical implications of the code that you write?" This question intrigued me because when I first saw it, my instinct was that there must be an objectively right answer.
00:01:58.649
However, it made me think of a tweet from Pablo Hidalgo, one of the Star Wars writers. He remarked that every time someone thinks something is obvious, it’s worth remembering there are people on Twitter who need reminders that the Empire are the bad guys in Star Wars. So, perhaps it’s not so obvious after all.
00:02:25.270
I often see tweets that discuss the implications of personal work. I hear phrases like, "I’m just an engineer," as if that absolves one from responsibility, which I find to be quite dangerous. That’s what I want to address today.
00:02:54.720
Before I dive deeper, I’d like to give a spoiler warning. The first part of my talk will cover Rogue One, so I hope we’re all caught up since it’s been out for more than a year and a half. Just so you know, they do get the Death Star plans at the end if you’re living in a bubble since 1977.
00:03:12.670
In the second part of my talk, I will discuss spoilers for Season 2 and 3 of Star Wars Rebels, though I’m uncertain how many care about that aside from me. Finally, in the last five minutes, I’ll touch on The Last Jedi. When I last presented this talk, it was just two weeks after that movie came out, and a number of attendees walked out at the end, which I can respect.
00:03:38.140
But I’m excited to highlight Rogue One specifically because it holds significant importance for me as a Star Wars fan. I saw the trailers and was thrilled about the group of rebels, many of whom were marginalized people fighting against the establishment. I thought, 'This is going to be amazing; I’ll relate to them and it’s going to be awesome.' However, that is not what happened at all.
00:04:03.910
The character I related to most in Rogue One was a character you can infer is the bad guy because he wears a white cape. After watching the movie, I came home with a sinking feeling: 'What am I doing with my career?' I want to share how I arrived at this realization.
00:04:26.710
It’s important to note that Star Wars is this classic tale of good versus evil. On the surface, one might think there’s no room for gray areas. If you’ve never seen Star Wars and look at this image, it’s pretty clear: these are the good guys, and those are the bad guys, right? It might make you feel comfortable thinking that as long as you're not one of the bad ones, you're in the clear.
00:04:50.960
However, I realized that it's not so simple. Tweets from a smart person named Kate Crawford made me reflect on the topic of ethics post the last presidential election. She spoke about being invited to construct something unethical or dangerous. She raised important questions: will you work on a Muslim registry, help locate undocumented workers, or use facial recognition to track protesters?
00:05:15.470
She stated that the technical community, especially in Silicon Valley, needs to firmly articulate what they stand for and what they won’t support. This steered my thoughts towards modern morality and how these ideals fit into my career. I began to realize that good people can do bad things, sometimes for misguided reasons or simply due to lack of awareness.
00:05:37.160
As I explored these gray areas, I grasped that even in Star Wars, gray areas exist. Take Anakin Skywalker, for example. He was once a great Jedi leader and a war hero, yet many villains in Star Wars were originally heroes who unintentionally fell to the dark side or got tricked. Take Count Dooku—originally a great Jedi—or Kylo Ren, whose parentage set high expectations, only for them to spiral into darkness.
00:05:59.290
Furthermore, even Jedi who remain good must face their temptations and make conscious decisions to stay heroes. For instance, when Luke Skywalker learns Darth Vader is his father, he’s met with a tempting offer—"Rule the galaxy with me." Similarly, Rey in The Force Awakens learns of her powers and is almost immediately drawn to Kylo Ren's offer of training.
00:06:13.760
Obi-Wan faced temptation on Mandalore, Ezra Bridger wrestled with harnessing the dark side, and even Master Yoda encountered temptation. If Yoda struggles, then it’s a universal experience for us all, indicating that we’re all subject to similar ethical dilemmas.
00:06:46.180
I recently read a novel titled Catalyst, which serves as the prequel to Rogue One. The story revolves around Orson Krennic, the director of advanced weapons research, and Galen Erso, the lead engineer on the Death Star project. It uncovers their backstories, particularly how Galen ended up working on the Death Star. Galen was a known pacifist who wanted nothing to do with the government and initially did not realize he would end up in his situation.
00:07:09.710
Galen desired to work in renewable energy, holding onto the hope that he could contribute positively after being nudged toward a project that he believed would achieve that goal. However, it didn’t take long for him to realize they were using this technology for weapon development.
00:07:33.280
There’s a significant quote in the novel that switched my perspective on the subject. Galen's mentor who was involved in the government said, "The war has altered everything, not only for those of us directly involved in the conflict but also for many of us here in Khorasan. Count Dooku's actions forced us to confront a harsh reality. Many of us have traded theory for practicality while enjoying the benefits of unlimited funding for research."
00:08:01.500
While reading this, I thought, 'Who wouldn't want this job?' I initially felt frustrated with Galen’s resistance to joining her. Yet as I was aware of the impending Death Star project, I reflected that I too might have fallen for it. That was when it hit me: if I had lived in the Star Wars universe, I may have been among the engineers working on the Death Star project.
00:08:25.240
I realized I had never effectively assigned a sense of morality to my work. If you view your work disconnected from morality—whether morally neutral or unreasonable—you might tread into dangerous waters without even realizing it. This aspect leads me to the importance of self-accountability.
00:09:05.510
The moment you face an ethical dilemma is not the ideal time to figure out your moral lines. Waiting until the moment presents itself is an easy way to justify a decision you wouldn’t usually support. Instead, it’s crucial to deliberate these matters well in advance to prepare for choices that could arise later.
00:09:38.300
If you don’t feel ready to make a big decision, don’t pressure yourself into immediate action. It’s vital to take time to ponder significant choices in your career. If someone is pushing you to decide quickly, question their motives.
00:10:05.710
Writing down your thoughts concerning your moral code can prove valuable. If you encounter a decision unexpectedly, you likely won’t be at the forefront of ethical contemplation. Thus, looking back at your reflective notes can guide you on your ethical pathway.
00:10:26.220
Essentially, holding yourself accountable means refraining from doing harm, even in jest. I once created a graphic I shared online that I found funny. Eventually, I removed it because I realized even if only one person shared their information and faced identity theft, it would reflect on me.
00:10:50.320
A friend of mine, Brenna, tweeted a thought that resonated with me. She stated that the question should always be, "Should we build the thing?" instead of, "Can we build it?" I believe we have the ability to build almost anything, but understanding how it fits into society requires more nuance.
00:11:17.500
As developers, we can become overly captivated by the idea of could we do it, viewing it as an intriguing puzzle to solve. Though I fully sympathize with this ideal, recognizing once the thing is made that it may be harmful should come prior to finalizing it.
00:11:45.310
We’ve predominantly referenced Star Wars, but this doesn’t solely occur in fiction. For context, I reference a quote from Einstein regarding his reaction upon learning about the consequences of the atomic bomb's use. Though he never worked directly on it, he expressed deep regret for having supported the use of his research to fuel its creation.
00:12:14.500
Einstein stated, "Had I known the Germans would not succeed in producing an atomic bomb, I never would have lifted a finger." This sentiment about regret among inventors is prevalent. For instance, Mikhail Kalashnikov, who created the AK-47, expressed sorrow over the destruction it caused.
00:12:34.500
Similarly, the inventor of pepper spray later felt remorse after witnessing its misuse. Meanwhile, Robert Probst, designer of the cubicle, originally intended for it to facilitate flexible teamwork, later regretted the corporate culture it inadvertently fostered.
00:12:57.750
The common thread among these examples is that you cannot control how people will use your work once it’s out in the world. This concept resonates sharply with coding; repurposed code is easier for malicious intents.
00:13:10.700
Code itself lacks context regarding its intended use; only the developers wield the insight about its application. We need to be more conscious and decisive about what is paramount to us. Consider technologies similar to yours and reflect on how your work may inadvertently align with unethical usage.
00:13:31.330
As Kate Crawford noted, facial recognition software for targeting protesters raised ethical concerns. If you’ve clearly established a stance against using it in one context, you may also need to think seriously about employing similar technologies in different spheres, such as a video game, where facial recognition could also be utilized to identify players.
00:14:01.060
I encourage you to weigh the implications of your work within the larger ethical landscape. Be conscious about the decisions you make based on these reflections.
00:14:29.960
This moral landscape is a crucial element in Catalyst and Rogue One; Galen Erso likely wouldn’t have participated in the project had he known his contributions would be repurposed for the Death Star. I figure the quote, "Any sufficiently advanced neglect is indistinguishable from malice," resonates strongly and emphasizes the complexities of the developer's ethical landscape.
00:15:03.200
Neglect vs. malevolence is pertinent to ethical framing as well. We know that just one malicious individual can exploit a system built poorly. Organizations exhibiting neglect could be at risk, too. If 99 individuals at a company lack an ethical vision, one person can lead the charge down a harmful path unchecked.
00:15:37.490
We’re navigating discussions about moral responsibility, and hopefully, you’re not one of those who lack the ethos and ethical standards. But what if you face the realization that a superior lacks those qualities? It’s a chilling thought to work for such a corrupt organization.
00:16:06.660
The Empire represents the epitome of unethical practice. They employ millions, if not billions, of people. If you find yourself caught in such a situation, you have choices to make. You could decide not to care and sell your integrity short, or you could choose to take a stand by quitting.
00:16:33.200
Reflecting on Galen Erso's journey, he handled the guilt tied to his association with the Death Star. Yet, sabotage doesn’t always manifest blatantly. I want to mention another character, Agent Kallus, from Star Wars Rebels.
00:17:01.690
Kallus is a high-ranking imperial officer, the embodiment of the Empire's ethos. He initially believed wholeheartedly in what he was doing, yet his story reveals a complex redemption arc. In a twist, he is stranded alongside Zeb, a rebel, and together they’re forced to collaborate for survival.
00:17:32.930
Despite my usual objections to this trope, it’s executed well in the series because Zeb displays confidence and choice in not engaging in a futile debate. He intuitively plants seeds of doubt in Kallus’s mind about the Empire and provides him a sense of trust once his friendships are rekindled after his friends stage a rescue.
00:17:58.150
Kallus, however, finds himself alone when his friends abandon him. This realization leads him to defect and become Agent Fulcrum, effectively aiding the rebellion. His arc illustrates a potential pathway for questioning one’s role and contributions to evil organizations.
00:18:21.810
Exploring alternatives to quitting isn't just about abandoning projects. It can involve persuading your employer or organization to shift their practices. Not everything aligns in stark black and white. If you worked for a literal embodiment of evil, like the Empire, it might seem impossible to change their inherent nature.
00:18:50.700
But if you find yourself in an environment where neglect reigns, challenge that structure. Whistleblowing embodies the spirit of moral responsibility we must embrace. Essentially, Kallus acted as a spy for the rebels, providing them with critical insight.
00:19:20.290
Engaging in activism and challenging unethical practices can feel overwhelming, spawning the sentiment of 'if you can’t beat them, join them.' People often think, 'Someone will do it anyway, so it may as well be me.' It’s tempting to succumb to manipulation from those in power, especially for marginalized individuals searching for safety.
00:19:43.160
I understand the complexities that marginalized individuals may face, and I’m not here to pressure anyone into harmful situations. I recognize that the dynamics of safety can make it feel difficult to resist unethical practices, yet if you possess the luxury of choice, ponder this carefully.
00:20:05.540
Working for an unethical organization doesn’t guarantee that one will be cared for as a person; those in power act out of self-interest. In Star Wars media, the contrast between the rebellion and Empire is stark. Rebels embody care and genuine concern for one another, while the Empire fosters selfish competition.
00:20:29.610
The competitive nature of the Empire transforms all relationships into a toxic quest for power. Rising through the ranks implies other employees are rallying for your failure, as exploitation underpins the structure. Krennic serves as an apt representation of these damaging dynamics.
00:20:52.490
I previously mentioned relating to Krennic, as he exhibits ambition and networking prowess. I often find myself drawn to relationships, yet grappling with this connection allows me to self-reflect on what traits I strive to avoid.
00:21:17.360
Krennic’s hard work led to the Death Star’s creation, but he fell victim to the very system he supported. Employees like him expend their lives building harmful systems without realizing it, leaving them without acknowledgment or compensation.
00:21:39.630
As we tackle the layers of gray morality, The Last Jedi further complicates this narrative. The divide between light and dark becomes increasingly blurred. Luke was attempting to impart a lesson on the force and existence of good and evil, teaching Rey about this nuanced understanding.
00:22:04.510
Benicio Del Toro’s character, DJ, reiterates this complexity, addressing the messiness of good and bad. I concur with his perspective that it’s easy to classify events simplistically, but is that viewpoint truly applicable in real-world scenarios?
00:22:28.880
One powerful lesson I personally gleaned from The Last Jedi arises from Poe Dameron’s miscalculations. He initially doubted his new superior’s judgment and acted without full knowledge, leading to disastrous consequences.
00:22:50.160
Despite believing in his intentions, he struggled with lack of trust and insufficient information, showcasing that even the best of intentions can falter when context is missing. This principle applies broadly, as we often find ourselves in similar scenarios.
00:23:14.160
Consequently, I derived three lessons from the film. Firstly, acquire all necessary information before rushing decisions. Conversely, leaders must also embrace transparency, as this openness encourages informed choices among those they lead. Poe faced challenges, but transparency could have averted many of these issues.
00:23:37.660
Finally, Yoda provides a reflective lesson: the greatest teacher is failure. Accepting and making peace with failure is crucial, but ultimately necessitates striving to improve.
00:24:04.800
In conclusion, I don’t possess definitive answers about morality and technology. Every individual must navigate their line. It’s vital to approach your endeavors thoughtfully, allowing a deliberate decision-making process to flourish.
00:24:29.030
My hope is that with a greater sense of awareness, we can all prevent ourselves from inadvertently building another Death Star.
00:25:01.830
Thank you.
