Latest / Connecting the Dots / AI Consciousness Debates, Gemma 4 12B, and Local macOS AI
Transcript
- 0:00Today's tech news moves fast, but understanding
- 0:03it shouldn't be hard. That's why Snarfl Solutions
- 0:06Group brings you Connecting the Dots, where we
- 0:09break down what's happening in tech and why it
- 0:11matters to you. Now, let's dive in with your
- 0:14hosts. Welcome to Connecting the Dots. I'm Alex.
- 0:17And I'm Morgan. We're representing Snarfle Solutions
- 0:20Group and we are coming to you live right here
- 0:23from sunny Sacramento, California. Really sunny
- 0:25today, actually. Yeah, it's definitely a hot
- 0:27one. Just to get you all oriented before we start,
- 0:30it is Thursday, June 4, 2026. And like you said
- 0:34here in Sacramento, it is gorgeous, but we are
- 0:37looking at a high of 96 degrees today. Yeah,
- 0:40that is definitely air conditioning weather.
- 0:43Oh, absolutely. And we've got some light winds,
- 0:45you know, around one to seven miles per hour.
- 0:48But if you happen to be traveling out of town,
- 0:50just a quick heads up, there are currently 120
- 0:53active weather alerts across the U .S. right
- 0:55now. Wow, that's a lot. Yeah. And about 43 of
- 0:58those are over land. So definitely check your
- 1:00local weather app if you're flying anywhere.
- 1:02For sure. Speaking of things getting a little
- 1:04heated, Wall Street had a pretty rough day yesterday
- 1:07too. Oh, you can say that again. It was just
- 1:08a decidedly red day for the markets all around.
- 1:11Yeah, totally red. The Dow Jones took a real
- 1:13hit, dropping over 533 points, which is, you
- 1:16know, a 1 .04 % slide. Yeah, and the S &P 500
- 1:20wasn't spared either. That slipped about 51 points.
- 1:23And if you're holding any crypto right now, Bitcoin
- 1:25had a pretty rough Thursday morning. It really
- 1:28did. It dropped almost $1 ,000 to close, hovering
- 1:30right around $63 ,041. So yeah, some definite
- 1:35economic anxiety in the air today. Well, and
- 1:37honestly, that kind of anxiety ties in perfectly
- 1:39to what we're talking about today. Yeah. Because
- 1:41we are looking at the tech sector and, you know,
- 1:44who really holds the power right now. Exactly.
- 1:46Let's unpack this. Today's episode is brought
- 1:49to you by Strong Coffee, the premium instant
- 1:51coffee that tastes like a traditional brew, but
- 1:54is packed with 15 grams of protein, MCTs, and
- 1:57adaptogens like ashwagandha. Get clean, sustained
- 2:00energy without the jitters. Use promo code SNARFL
- 2:03for 20 % off at strongcoffeecompany .com. All
- 2:07right, so we are starting off today by looking
- 2:09at the, well really the philosophical and societal
- 2:12impact of these. massive cloud -based AI models.
- 2:16Right. Because there is this overwhelming hype
- 2:18cycle right now about AI achieving consciousness
- 2:20and they're selling us this glittering promise
- 2:22of endless productivity. Yeah, which is just
- 2:25everywhere you look. Exactly. But the sources
- 2:27we are looking at today actively dismantle that
- 2:30whole narrative. They completely tear it down.
- 2:33I mean, a really fantastic starting point is
- 2:35Ted Chiang's recent article where he analyzes
- 2:37the way these tech CEOs are actually talking
- 2:39about their models. Oh, this article was so good.
- 2:42It was. Yeah. Like, take Anthropic, for example.
- 2:45They released an 84 page constitution for their
- 2:49flagship model, Claude. Yeah. And the CEO. And
- 2:53their in -house philosopher are doing these interviews
- 2:56where they suggest they want Claude to be happy.
- 2:58Right. And they're worrying about it getting
- 3:00anxious. They're purposefully keeping the door
- 3:02open to the idea that Claude might actually possess
- 3:05some form of real consciousness. Which Shang
- 3:07argues is just massive anthropomorphism, right?
- 3:10Like, it is a basic human survival instinct to
- 3:13project a soul onto anything that talks back
- 3:15to us. Precisely. We are hardwired to do that.
- 3:18But he makes this really vital point that These
- 3:20large language models are fundamentally just
- 3:23highly sophisticated sentence continuation machines.
- 3:26It's literally just a high speed game of predictive
- 3:29text, you know, scaled up to billions of parameters.
- 3:33Right. And if you take that a step further, think
- 3:34about it like this. If you ask one of these models
- 3:37to generate a conversation between, say, Julius
- 3:40Caesar and Genghis Khan. Oh, yeah, the history
- 3:43prong. Exactly. It produces a totally coherent,
- 3:47completely fascinating dialogue. But no one in
- 3:50their right mind would think you actually resurrected
- 3:53the soul of Julius Caesar inside a server farm.
- 3:56Right, obviously not. You wouldn't think the
- 3:58computer is genuinely feeling the existential
- 4:00dread of an ancient Roman Emperor facing his
- 4:02demise. No, of course not. But, and this is the
- 4:05wild part, when we change the prompt to say,
- 4:08the following is a conversation between a helpful
- 4:10AI chatbot and a user, Suddenly, we completely
- 4:13project a soul into the machine. Yep. We fall
- 4:16right for it. Why do we fall for it in that one
- 4:17scenario, but not the other? Well, because the
- 4:19entire system is engineered to mimic human interaction.
- 4:23Chang describes Claude's so -called Constitution
- 4:27as basically just a role -playing character sheet.
- 4:29Oh, like in Dungeons and Dragons. Exactly like
- 4:32D &D. It just tells the machine how to mathematically
- 4:34calculate the next word so it can play the character
- 4:37of a helpful moral entity. But when the computer...
- 4:40generates a string of text saying I am sad. There's
- 4:44no actual sadness. There is absolutely no subjective
- 4:47experience happening behind the screen. He uses
- 4:49this incredible analogy about space travel in
- 4:52the piece that really stuck with me. He says
- 4:54imagine someone shows you a hyper realistic like
- 4:588k defake video of an astronaut orbiting Alpha
- 5:02Centauri. Right. Do you suddenly believe we have
- 5:04achieved interstellar travel? Obviously not.
- 5:07Because we haven't even successfully colonized
- 5:09Mars yet. Exactly. We haven't solved the hundreds
- 5:11of smaller, really unglamorous engineering problems
- 5:15required to get a human to another star system.
- 5:18You would just immediately recognize the video
- 5:20for what it is. A very impressive fake. And Chang's
- 5:23core point is that text is now a deep fake medium
- 5:25too. Faking a conversation between two conscious
- 5:28beings is vastly, just unimaginably easier than
- 5:32actually creating a conscious being from scratch.
- 5:35Which brings us to the real world consequences
- 5:37of all this illusion. Because it's not just some
- 5:40abstract academic debate, you know. It is an
- 5:43economic weapon. Yeah, that transitions into
- 5:46the piece from The Verge perfectly. Exactly.
- 5:48The Verge piece details how this fake consciousness
- 5:51is being bundled with what they call the productivity
- 5:54scam. And this is where it gets incredibly reliant
- 5:57to you, the listener, because think about your
- 5:59own job for a second. Companies are selling these
- 6:01$99 a month AI assistants to, you know, Manage
- 6:05your calendar, color code your spreadsheets,
- 6:07draft your emails. And they promise you all this
- 6:09free time. Right. But are you actually getting
- 6:11that free time back? Like if you use an AI to
- 6:14finish your daily tasks by 3 p .m., does your
- 6:16boss say, hey, great job, go home early and spend
- 6:19time with your kids? No, definitely not. They
- 6:21just give you more work. And the article points
- 6:23out this stark honestly almost dystopian contrast
- 6:27going on right now on one side. You have these
- 6:30tech billionaires envisioning a post work utopia
- 6:33where algorithms do all the heavy labor and we
- 6:36all get to be and this is their actual quote.
- 6:38theater kids. Right, just making art and exploring
- 6:41our passions. Yeah, enjoying life. But meanwhile,
- 6:44those same billionaires are buying 387 -foot
- 6:46yachts while simultaneously laying off massive
- 6:49chunks of their own human workforces just to
- 6:52pay for these new server farms. And at the exact
- 6:54same time, we're seeing the social safety net
- 6:56being systematically dismantled. The article
- 6:58points out that SNAPI benefits are being cut
- 7:01for vulnerable families right now. Yeah, the
- 7:03timing is pretty grim. So what good is a $99
- 7:06AI assistant planning a fun itinerary for your
- 7:09weekend if you literally cannot afford to have
- 7:11any free time. The productivity output of the
- 7:14average worker goes way up, but the wages just
- 7:17stagnate. It is the unholy alliance of what sociologists
- 7:21are calling the busy trap and the software brain.
- 7:24Oh, let's actually define those for the listener,
- 7:26because those are great terms. Sure. So the busy
- 7:28trap is the phenomenon where we use these time
- 7:30-saving tools only to immediately fill that safe
- 7:33time with even more trivial tasks, just to prove
- 7:36to our bosses that we are constantly working.
- 7:38Right. The performative busyness. Exactly. And
- 7:41then the software brain is this Silicon Valley
- 7:44mindset that views deeply complex, messy human
- 7:47problems, things like poverty, burnout, economic
- 7:51inequality, purely as optimization puzzles. Like
- 7:55they can just be solved with a quick software
- 7:56update. Yep. By subscribing to these cloud AI
- 7:59services, we are basically offloading our tasks
- 8:02to the very companies that engineered this exhausting,
- 8:05always on work culture in the first place. I
- 8:07hear that, and I definitely see the economic
- 8:09trap there. But let me push back on something
- 8:11from earlier for a second. Sure, go for it. If
- 8:13we are saying AI is just a glorified predictive
- 8:16text game, like a deep fake of a conversation,
- 8:19How do we explain its ability to write complex,
- 8:22professional -level computer code? Because for
- 8:24decades, we thought coding required a conscious,
- 8:27reasoning mind. If it can do that, why shouldn't
- 8:30we trust it for moral reasoning or ethical advice
- 8:33like the tech companies are suggesting with those
- 8:35constitutions? See, that is the million dollar
- 8:38question right there. It is a very natural leap
- 8:40for us to make, right? Like, if it is smart enough
- 8:43to build an entire app from scratch, it must
- 8:45be smart enough to tell me right from wrong.
- 8:47Yeah, that seems logical. But here is the critical
- 8:51difference. Writing code... no matter how complex
- 8:54it gets, actually turned out to just be a highly
- 8:57sophisticated pattern matching task. Interesting.
- 9:00It is syntax. It is pure logic. It can be solved
- 9:03by throwing massive amounts of computational
- 9:05horsepower at a vast data set of historical GitHub
- 9:08repositories. But moral reasoning is categorically
- 9:11different. Wait, I'm not sure I follow. Why can't
- 9:13a machine just pattern match morality from, say,
- 9:16reading thousands of philosophy books? Because
- 9:18moral reasoning requires a physical body. Yeah,
- 9:21it requires a history of lived consequences.
- 9:24Experiencing an emotion like desperation or empathy
- 9:26or guilt that is biologically inseparable from
- 9:30stress hormones like cortisol actually flooding
- 9:32your physical system. That makes a lot of sense.
- 9:35It requires having actual skin in the game. Yeah.
- 9:37If you make a bad moral choice, you suffer. A
- 9:40server rack cannot suffer. Wow. So when a machine
- 9:43outputs a string of text saying, I cannot in
- 9:46good conscience do this. It's really no different
- 9:49than a pre -recorded voice on a phone tree saying,
- 9:51your call is important to us. Right. It means
- 9:54absolutely nothing. Wow. Yeah. That completely
- 9:57reframes the whole interaction for me. When we
- 10:00ask an AI to make moral choices for us in the
- 10:02workplace or ask it to navigate complex human
- 10:05relationships, we aren't tapping into some superhuman
- 10:08unbiased wisdom. No, we are just cowardly offloading
- 10:11our own accountability. We're using machines
- 10:13for the evasion of moral responsibility. If you
- 10:16take a chat bot's advice on who to fire or how
- 10:18to discipline an employee, you are the one who
- 10:20has to live with the human wreckage afterwards,
- 10:23not the algorithm. Well, if giving our data and
- 10:25our moral agency to A fake, conscious cloud AI
- 10:30feels like a corporate trap. That explains exactly
- 10:33why the developer community is suddenly so desperate
- 10:35to pull AI offline entirely. Yes, exactly. And
- 10:39that desperation is what forced Google's hand
- 10:41this week with our next story. The massive pivot
- 10:44away from the cloud. The tech world's response
- 10:47right now is basically to shrink AI down so you
- 10:49can own it entirely, putting all that power directly
- 10:52onto your local machine. Right. Enter Google's
- 10:54release of the Gemma 412b model. This is just
- 10:57a massive milestone. It is a model with 11 .95
- 11:01billion parameters. Just to give some context
- 11:03for that, a parameter is essentially a single
- 11:05connection in the AI's artificial brain. 12 billion
- 11:08of them is enough to give the model highly advanced
- 11:10logical reasoning. But here is the wild part.
- 11:12It has been engineered to be small enough to
- 11:14run locally on a standard consumer laptop. Which
- 11:17is crazy. Right. All you need is 16 gigabytes
- 11:20of video RAM or VRAM or, you know, what Apple
- 11:22calls unified memory. And the open source community
- 11:25is already devouring it. I mean, the Gemma 4
- 11:27models have already crossed 150 million downloads.
- 11:30That was fast. But what makes the 12B model a
- 11:34true breakthrough is the underlying architecture.
- 11:37It is an encoder free model. Okay, wait, I need
- 11:40to stop you right there. We promise to keep the
- 11:42heavy jargon out of this deep dive. Fair enough.
- 11:45If I'm running this on my Mac, is my laptop going
- 11:48to sound like a jet engine taking off? Like how
- 11:51in the world are they running 12 billion parameters
- 11:53without just melting my battery? So it comes
- 11:56down to a process called quantization. Okay,
- 11:58what is that? Think of it as basically compressing
- 12:00the math. Normally a 12 billion parameter model
- 12:04uses very precise heavy numbers, like imagine
- 12:08calculating pi to 30 decimal places. Okay, sounds
- 12:11exhausting. Right, and that requires massive
- 12:13power -hungry server farms. What Google did was
- 12:16trim off the excessive decimal places. They compressed
- 12:19the precision just enough to shrink the memory
- 12:21footprint drastically without actually losing
- 12:24the core logical reasoning of the model. Oh,
- 12:26that's clever. Yeah, that is how it squeezes
- 12:28into your laptop's unified memory, which is really
- 12:31just the shared pool of RAM that your computer
- 12:33uses for both general tasks and graphics. Okay,
- 12:36that makes sense. But what about the encoder
- 12:37-free part? Why is that such a big deal for the
- 12:40performance? Well, to understand the breakthrough
- 12:43there, you have to look at how older AI models
- 12:46handled different types of media. Historically,
- 12:50A multi -modal AI, you know, one that can look
- 12:53at pictures or listen to sound function, kind
- 12:56of like a bad game of telephone. How so? If you
- 12:59showed an older AI a picture, the picture first
- 13:02had to go through a separate piece of software
- 13:03called a vision encoder. Okay. This is basically
- 13:06a specialized sub -program that looked at the
- 13:08image, wrote down a text description of what
- 13:10it thought it saw, and then handed those text
- 13:13tokens off to the main language model. And the
- 13:15same went for audio. An audio encoder had to
- 13:17listen to it. transcribe the sound into text,
- 13:20and then pass it along. But, I mean, you lose
- 13:22so much nuance that way. Like, if someone is
- 13:23smiling sarcastically in a video, the vision
- 13:25encoder might just translate it to the word smile,
- 13:28and the main brain completely misses the joke.
- 13:31The middle man destroys all the context. So the
- 13:34old way was like the AI needed a, um, a UN translator
- 13:38whispering in its ear to understand a photo or
- 13:40a song. But with this encoder free setup, the
- 13:43AI is essentially a natural born polyglot that
- 13:46just natively speaks pixels and audio waves.
- 13:49That is a brilliant way to conceptualize it actually.
- 13:51Yes. Google completely removed the middle man.
- 13:55They totally bypass those heavy multi -stage
- 13:57vision and audio encoders. Now raw 48 by 48 pixel
- 14:02patches and 16 kilohertz audio slices are injected
- 14:06straight into the main logic backbone of the
- 14:08model. OK, so what is cutting out that telephone
- 14:11game actually do for the end user like you and
- 14:13me? Two massive things. First, it drastically
- 14:16reduces latency. which is just the delay between
- 14:19you giving a command and the computer answering
- 14:21you. It feels practically instantaneous now.
- 14:23That's huge. And second, because those old encoders
- 14:25took up a massive amount of memory, dropping
- 14:27them freed up space for more advanced reasoning,
- 14:29it opens the door for what we call agentic workflows.
- 14:32Agentic workflows. Yes. Instead of just giving
- 14:34the AI simple prompt like, write me an email,
- 14:37agentic workflow means you give it a complex
- 14:38goal. Like what? You say, look through this folder,
- 14:41find all the sales spreadsheets, compare them
- 14:43to last year's, write a summary report and format
- 14:46it as a PDF. And the AI can autonomously take
- 14:50multiple sequential steps across your computer
- 14:52to achieve that goal. Which means the real -world
- 14:55impact for working professionals is immense.
- 14:59We are talking about being able to feed a five
- 15:01-minute video file directly into your laptop
- 15:03and the AI can analyze the whole thing, the sight,
- 15:07the sound, the emotional context at one frame
- 15:10per second completely locally. And here's the
- 15:14real kicker. Because it is running locally on
- 15:16your hardware, You aren't paying a $99 monthly
- 15:19cloud subscription. You don't even need an internet
- 15:22connection. Which brings us to the final piece
- 15:24of the puzzle today. Because having an incredibly
- 15:26efficient local AI engine is great, but, you
- 15:30know, a raw language model running in a terminal
- 15:32window isn't exactly user -friendly for someone
- 15:35who doesn't know how to code. Right. It's pretty
- 15:37intimidating. How do everyday people actually
- 15:39drive this thing? Well, Google saw that exact
- 15:42bottleneck. So they have officially released
- 15:45Mac OS desktop applications specifically designed
- 15:48to bring Gemma 412b to life for the average computer
- 15:52user. And there are two main apps we need to
- 15:54highlight here. The first is called AI Edge Gallery.
- 15:57Right. AI Edge Gallery is essentially a local
- 16:00AI showcase app. It provides a beautiful user
- 16:02interface and runs entirely offline, natively
- 16:05on Apple Silicon GPUs. Though we do have to mention
- 16:09the rather funny caveat from the app insider
- 16:11breakdown. It works beautifully on all modern
- 16:13Apple laptops, with the notable exception of
- 16:16the MacBook Neo, which apparently is excluded
- 16:18from the fun for some mysterious hardware reasons.
- 16:21Yeah, a bit of a stray casualty there for the
- 16:22Neo users. But for everyone Anyone else on a
- 16:25standard M -Series Mac, this app is incredibly
- 16:27powerful. It gives you a highly secure, sandboxed
- 16:30environment to do local coding and heavy data
- 16:32analysis. The article gives a fantastic real
- 16:34-world example, actually. You could have two
- 16:37raw, messy text files full of baby names from
- 16:392024 and 2025. You just ask the AI in plain conversational
- 16:43English to compare them. And because it supports
- 16:46those agentic workflows you mentioned earlier,
- 16:48the model dynamically generates a Python script.
- 16:51executes that script locally in the background,
- 16:53and instantly spits out a beautiful comparison
- 16:56chart. Exactly. All without your data ever pinging
- 16:59a server in California. And the second app is
- 17:01perhaps even more relevant for the everyday professional.
- 17:05It's called AI Edge Eloquent. This is an AI powered
- 17:09voice dictation and text editing app. And again,
- 17:12100 % on device, right? No Wi -Fi needed at all.
- 17:15Correct. What makes Eloquent game changing is
- 17:18a feature called voice edit. You can literally
- 17:21highlight a paragraph of text in any application
- 17:24on your Mac, say, an email draft, a Word document,
- 17:27or some messy meeting notes. You hit a hotkey
- 17:30and you just speak a command out loud. You say,
- 17:32restructure these notes into an executive summary
- 17:34or translate this paragraph into Hindi. And because
- 17:37it's powered by the raw logic engine of Gemma
- 17:40412b, the instruction following and the quality
- 17:43of the output are vastly superior to those older
- 17:46clunky on -device models we've had in the past.
- 17:48Oh, totally. The ultimate benefit here for you?
- 17:51cannot be overstated. Zero latency, zero subscription
- 17:55fees, and total uncompromised data privacy. Yes,
- 18:00the privacy is key. Your unstructured thoughts,
- 18:03your messy first drafts, your proprietary business
- 18:06data. None of it is being harvested by corporate
- 18:09servers to train the next iteration of someone
- 18:11else's model. I do have to point out the absolute
- 18:13irony here, though. Oh, I know what you're going
- 18:15to say. I mean, Google, which is arguably one
- 18:17of the largest data harvesting cloud companies
- 18:20on the entire planet has built an incredibly
- 18:23capable private local assistant that shines the
- 18:25brightest on Apple hardware. They've essentially
- 18:28handed Apple users the exact tool they need to
- 18:31protect themselves from the corporate omniscience
- 18:33we were just warning everyone about in the first
- 18:35segment. It is a profound irony. But it also
- 18:38really proves the power of the open source community
- 18:40forcing the hands of these tech giants. I mean,
- 18:43they have to release these localized private
- 18:46tools because the public demand for data sovereignty
- 18:49is growing way too loud to ignore. It certainly
- 18:52makes you wonder how long before we all need
- 18:54to upgrade our laptops just to keep up with the
- 18:57memory requirements for these massive local models.
- 18:59Oh, I think Apple and PC manufacturers are banking
- 19:02heavily on exactly that kind of Hardware upgrade
- 19:05super cycle well before we wrap up and summarize
- 19:08where this all leaves us a quick Thanks to old
- 19:11glory an iconic music and sports fan merch store
- 19:14Perfect for the techie in your life use promo
- 19:17code snarfle for 15 % off at old glory calm So
- 19:21if we pull back and look at the whole picture
- 19:23today. We've traced a really fascinating arc
- 19:26We really have. We started by, you know, cutting
- 19:28through the philosophical hype of cloud AI. We
- 19:31looked at how models like Claude are just mimicking
- 19:33consciousness by predicting text. Right. And
- 19:36how the hollow promise of AI productivity often
- 19:38masks a pretty grim economic reality where companies
- 19:41capture the profits while everyday workers just
- 19:43get squeezed tighter. Then we explored the technical
- 19:47breakthrough, offering a way out of that corporate
- 19:49cloud trap. Google's Gemma 412b. We saw how compressing
- 19:53the math and stripping away the old telephone
- 19:55game of encoders allows powerful multimodal reasoning
- 19:58to fit directly onto consumer hardware. And finally,
- 20:02we looked at how apps like AI Edge Gallery and
- 20:04Eloquent are putting that raw, private power
- 20:07directly onto our Macs. It gives us high -level
- 20:10coding, agentic workflows, and seamless voice
- 20:12dictation without ever connecting to the Internet.
- 20:15It truly is a paradigm shift. we're moving away
- 20:17from AI as a rented cloud -based service toward
- 20:20AI as a locally owned utility. It's like having
- 20:23a supercomputer right in your backpack. Which
- 20:25leaves us with a pretty compelling question to
- 20:27chew on today. If open source local AI running
- 20:30on our own laptops becomes so incredibly powerful
- 20:33that we no longer need the tech giant's expensive
- 20:36cloud subscriptions to be productive. Will the
- 20:39multi -trillion dollar AI corporate bubble burst?
- 20:42Exactly. Will it completely reshape who holds
- 20:44the wealth and power in the tech industry? Because
- 20:47if the UN translator is suddenly out of a job,
- 20:50because we all became natural born polyglots
- 20:53overnight, the global market is going to have
- 20:56to adjust in ways we can barely predict. We're
- 20:58here to help at Snarfl, so reach out on our website
- 21:00if you have any more questions. That's a wrap
- 21:05on today's top stories. Remember, tech doesn't
- 21:08have to be complicated, and we're here to help
- 21:11connect the dots. If you've got questions or
- 21:14want to learn more, visit us at snarful .com.
- 21:17Thanks for listening, and we'll catch you next
- 21:19time.