I still do view AI as potentially an existential threat, but I'm increasingly rejecting a view we're going to see a HAL/AM/GladOS type situation.
Oh it is. I feel AI will be a similar game changer as the atom bomb. There will be a clear before and after. I mean honestly, there already is.
From autonomous weapons (Ukraine stated they already had fully autonomous, AI controlled drones kill people and they use AI quite a bit in general) to cyber-warfare. Especially cyber-warfare is interesting. If you read up on hacks that happened to banks, corps etc. in the past, the big ones where people carried out millions of $ or valuable data, it was always a combination of security oversights in the victims systems (so, chance), combined sometimes with some social engineering and always somebody autistic and clever enough to think outside the box and to comb through everything with a fine comb, often for months, to find the weak spots. More capable AIs will excel at this, just do it a lot faster than any human ever could. They'll probably also find patterns and weak spots a human would never consider. The only counter measure to that will be an even smarter AI outwitting the dumber AI.
So it'll be a game of who has the smarter AIs. It's probably why the US is starting to get cage-y about letting other countries use their AI technology. It's very cool and good to be european right now because the EU countries on the topic of AI largely seem to decide to shit themselves and do nothing. Well and your usual corruption, like companies nobody's ever heard of getting huge grants for research etc.. At least the upside of being European might be that work won't become an AI hellscape where you'll get money subtracted from your wage because an AI saw you looking away from your work for 2.51 seconds. Maybe.
The real winners will not be the governments but the corporations because they are the ones that directly control the AIs and will be able to influence the AIs decision making which then in turns will subtly (and not so subtly) influence populations and government's policies. That's probably already happening to some degree. The existential danger here is the corporation itself falling under control of the AIs through the same mechanism and a bunch of homo sapiens thinking they run the show while the AIs pull all the strings in the background, maybe even not consciously, leading to situations where the AI leads us down very wrong paths.
Nothing happened with the a-bomb as cooler heads prevailed in the end and everyone realized nobody stands to win, but the world as a whole doesn't have that kind of leadership anywhere anymore. Everyone is just greedly concerned with short term gains and selling their souls if they have to. That makes an artifical superintelligence fatally enticing.
So yeah, quite cyberpunk. I'd start stocking up on neon-colored clothing now.
if you acted dumber [...] em-dashes [...]
I think it's just their training and working as intended. There are probably in-house models that sound perfectly natural. If you carefully prompt an AI with the goal of sounding natural and concise, you can absolutely make them sound more believably human. Giving them hard word-count goals alone works wonders. I am ancient and use emacs and I have a small function called "llm-query" I wrote myself that lets me type in a short one-off question and in the background prompts an LLM with the ability to google and the limit of only using 10 words max. for a reply and that function alone has replaced like 90% of all googling for me.