hey everyone writing code: you can't get around this. code does not exist in a noble mathematical void which absolves you of accountability. any system which people touch is tied into the fabric of society, and should be scrutinized for potential to do harm.

How to make a racist AI without really trying

"... the sentiment is generally more positive for…

@lorenschmidt wwwow, besides the obvious, even the vast difference between Emily and Heather is astounding

@lorenschmidt hey everyone writing mathematics: math does not exist in a noble mathematical void which absolves you of any accountability.

No kidding, my complex analysis prof taught us conformal maps, and then showed us how the Russians designed shaped charges with them before the war.


If you do a thing with no obvious application, and somebody else figures out a bad application for it, do you deserve any blame? Is Marie curie partially responsible for the atom bomb?

@lorenschmidt AI is always trained off of data we put into it.

It's basically garbage-in-garbage-out amplified.

@lorenschmidt "You can have data that’s better because it’s less racist. There was never anything “accurate” about the overt racism that word2vec and GloVe learned." — my favourite part I guess.

@lorenschmidt I think we need to go about this the other way: we need to really change the source of the problems in actual society, we need to normalize this diversity much more than emphasize the need for acceptance of something that people feel as weird.

@lorenschmidt One part of that is having an actually well-working international language. This bias is something we oblige to people wanting to join international culture. English is not culturally neutral.

This is because of slants in the training sets though, not in the code?


I mean that's not really due to being a (very very specialized, low-level) "AI", it's just statistics that does that.

This is a lesson in interpreting statistics I think.

But if we interpret it correctly, it's actually incredibly great!

The better interpretation being the "sentiment" value isn't how good it is, but how good *society thinks it is* or similar (since that's what it's based on)

So in that context, it could function as a bellwether for society's progress.

Sign in to participate in the conversation

Server run by the main developers of the project 🐘 It is not focused on any particular niche interest - everyone is welcome as long as you follow our code of conduct!