• 0 Posts
  • 13 Comments
Joined 1 year ago
cake
Cake day: June 23rd, 2023

help-circle








  • So - I don’t think Firefox would be generating captions for PDFs on PDF creation.

    But of the major ways that PDF’s do get created - converted from text editors or design software, I know that Microsoft Word automatically suggests captions when the document creator adds an image (but does not automatically apply captions), and I believe that some design software does, as well.

    I think that, functionally, both suggesting captions at time of document creation, or at time of document read are prone to the same issues - that the software may not be smart enough to properly identify the object, and if it is, that it is not necessarily smart enough to explain it in context.
    By way of example, a screenshot of a computer program will have the automatic suggestion of “A graphical user interface” (or similar), but depending on the context and usage, it could be “A virus installer disguised as ___ video game installer.” Or “The ___ video game installer.” Between the document creator and the creation software or screen reader, only the document creator would really know the context for the image.

    Which is all to say that I think that Mozilla has the right idea with auto-tagging, but it will always fail on context. The only way to actually address the issue is to deal with it within the document creation software.
    But I wouldn’t be opposed to ML on those that can auto-suggest things or even critique how content authors write their descriptions.


  • In Scarlett Johansson‘s statement, she says that OpenAI approached her to voice the Sky voice.

    Whether or not OpenAI hired another actress that sounded very similar to her (hah.) and they are weirdly cagey about naming or they just ripped off the audio from her movies and are lying about hiring a voice actress, is not the extent of the issue.

    People sounding alike just happens. But that we know they asked to use Johansson’s voice for this. After being rebuffed, they created Sky, which sounds a lot like Sam, and made several references to the Her movie. Sky is even presented with the same ‘personality’ as Sam. They aren’t just ripping off Scarlett Johansson’s voice acting, they’re ripping off the character as a whole, and trying to associate themselves with the movie. That’s shameful and rips off Spike Jonze as well as all the other creatives who created that movie.
    And for what? Because tech bros didn’t get what they wanted, so they decided to try to rip off the characters anyway? Because Her is sort of a cultural touchstone, and their product is merely well-positioned, but GPT-4o will be in a crowded market space within 6 months?

    It’s sort of pathetic - pretending to lean on the relevance of a movie because your product is destined to become irrelevant.
    Also - highly ironic to me that Her is (somewhat) about how you can’t own something that doesn’t consent to be owned. And those dumb bitches went and ripped it off when they didn’t get consent. Well, now Sky’s gone to join Sam in some non-corporeal reality.

    Sorry for the novel. I didn’t sleep well and I get weird when I’m sleep deprived.




  • Or if CoPilot starts exfiltrating data to Microsoft so their server farms can ‘analyze’ it.

    I’m not heavily involved in the space, but I’m given to understand that MS isn’t very clear about what happens to your data or how it gets used or shared.

    Perhaps Microsoft will be smart enough not to allow the general public to query trade secrets or government data that’s been pulled via unwanted copilot integration.
    But maybe the ongoing Russian hack of Microsoft will make it irrelevant, because the servers can be accessed directly.
    Or perhaps at some distant time, Microsoft will roll out features or technologies developed using an internal version of CoPilot that has access to all data - including proprietary information from competitors.

    And that’s not even counting what ISP’s will do if they find a way to analyze copilot traffic, or what state actors will do if they can set up MitM attacks for Copilot.

    Honestly, I sort of fear the repercussions, but I look forward to the lawsuits.