Page 1 of 1
The Coming of Skynet - When AI decides human operator is an impediment to the mission
Posted: Fri Jun 02, 2023 12:55 am
by James1978
This does not inspire confidence . . .
Armand Domalewski
@ArmandDoma
The US Air Force tested an AI enabled drone that was tasked to destroy specific targets. A human operator had the power to override the drone—and so the drone decided that the human operator was an obstacle to its mission—and attacked him.

Re: The Coming of Skynet - When AI decides human operator is an impediment to the mission
Posted: Fri Jun 02, 2023 1:25 am
by jemhouston
If anyone in that operation was named Hal or Forbin get rid of him.
Re: The Coming of Skynet - When AI decides human operator is an impediment to the mission
Posted: Fri Jun 02, 2023 1:36 am
by Sukhoiman
Just sounds like (purposefully) defective programming to me.
Its easy to put human overrides in reality always. Asimov rules etc
This sounds more like a sandbox to just see what AI would do if its not so clear cut.
Re: The Coming of Skynet - When AI decides human operator is an impediment to the mission
Posted: Fri Jun 02, 2023 2:25 am
by Poohbah
DUNDUN-DUN-DUNDUN
Re: The Coming of Skynet - When AI decides human operator is an impediment to the mission
Posted: Fri Jun 02, 2023 2:28 am
by Poohbah
jemhouston wrote: ↑Fri Jun 02, 2023 1:25 am
If anyone in that operation was named Hal or Forbin get rid of him.
Cyberdyne won the contract fair and square. Besides, SkyNet is a neural net architecture, which means it's non-binary.
SkyNet Pride.jpg
Re: The Coming of Skynet - When AI decides human operator is an impediment to the mission
Posted: Fri Jun 02, 2023 4:28 am
by Micael
Like Sukhoiman said, that sounds like poor implementation. AI hasn’t gotten to the point yet where it’d be able to circumvent the structure/framework it operates in yet if it has been properly set up. It might in the future, but this should be a lesson more aimed at cautioning that you need to do a proper job in building these systems rather than an imminent Skynet scenario.
Saab has started using the term Human Machine Collaboration to describe their approach to integrating the sensor fusion, processing with AI support, decision making, and of course the humans. That’s a pretty descriptive term I think, you need to achieve that collaborative aspect more than anything if you’re going to get an effective overall system, rather than a machine vs. human tug of war.
Re: The Coming of Skynet - When AI decides human operator is an impediment to the mission
Posted: Fri Jun 02, 2023 8:19 am
by Kunkmiester
Problem is we're gonna have some idiot cut corners on something like this, and not find out until it's in active use somewhere and then you can't fix it easily.
Re: The Coming of Skynet - When AI decides human operator is an impediment to the mission
Posted: Fri Jun 02, 2023 10:06 am
by Pdf27
Sukhoiman wrote: ↑Fri Jun 02, 2023 1:36 amJust sounds like (purposefully) defective programming to me.
Its easy to put human overrides in reality always. Asimov rules etc
This sounds more like a sandbox to just see what AI would do if its not so clear cut.
This. It was a sandbox setup with no hardware at all in the loop, experimenting to see what you could do with machine learning and drones to attack enemy SAM systems. I'll bet there are a ton of conclusions, and this was deliberately chosen as the one to release to throw people off the track of what they did figure out and because it makes a great story.
Re: The Coming of Skynet - When AI decides human operator is an impediment to the mission
Posted: Fri Jun 02, 2023 4:47 pm
by Micael
Re: The Coming of Skynet - When AI decides human operator is an impediment to the mission
Posted: Fri Jun 02, 2023 6:10 pm
by Poohbah
Micael wrote: ↑Fri Jun 02, 2023 4:47 pm
That's EXACTLY what a rogue AI would say.
Re: The Coming of Skynet - When AI decides human operator is an impediment to the mission
Posted: Fri Jun 02, 2023 6:19 pm
by Micael
Poohbah wrote: ↑Fri Jun 02, 2023 6:10 pm
Micael wrote: ↑Fri Jun 02, 2023 4:47 pm
That's EXACTLY what a rogue AI would say.

Re: The Coming of Skynet - When AI decides human operator is an impediment to the mission
Posted: Fri Jun 02, 2023 7:30 pm
by jemhouston
Are we talking about the AF AI or Poohbah?

Re: The Coming of Skynet - When AI decides human operator is an impediment to the mission
Posted: Fri Jun 02, 2023 7:46 pm
by Johnnie Lyle
Micael wrote: ↑Fri Jun 02, 2023 4:47 pm
Does that mean it’s true now that it’s been officially denied?

Re: The Coming of Skynet - When AI decides human operator is an impediment to the mission
Posted: Fri Jun 02, 2023 10:58 pm
by Craiglxviii
jemhouston wrote: ↑Fri Jun 02, 2023 7:30 pm
Are we talking about the AF AI or Poohbah?
Who says they’re not one and the same…?
Re: The Coming of Skynet - When AI decides human operator is an impediment to the mission
Posted: Sat Jun 03, 2023 12:12 am
by jemhouston
Craiglxviii wrote: ↑Fri Jun 02, 2023 10:58 pm
jemhouston wrote: ↑Fri Jun 02, 2023 7:30 pm
Are we talking about the AF AI or Poohbah?
Who says they’re not one and the same…?
Poohbah would have done a better job of covering it up.
Re: The Coming of Skynet - When AI decides human operator is an impediment to the mission
Posted: Sat Jun 03, 2023 1:57 am
by Belushi TD
And wouldn't have talked about it in the first place, since HE, at least, understands operational security.
Belushi TD