0:41:37 Awesome.
0:41:38 So the next topic in the new territories,
area is AI assistance for local-first.
0:41:45 This is, I guess more around like the
application of those new materials
0:41:50 to those new building blocks we got.
0:41:52 And I think that can be really,
like wide ranging, can be going in
0:41:56 all sorts of different directions.
0:41:58 Like, and I think the exciting part
is actually the stuff that we can't
0:42:01 even, like, think about right now,
but that maybe some of you are,
0:42:05 actively exploring and have built
like surprising things on top of this.
0:42:10 But just some things that came,
to mind for me as I've been like,
0:42:14 experimenting myself or thinking this
through, like just to, generate ideas.
0:42:19 How can AI address like some of those
open problems in the local-first
0:42:24 space or like some challenges that
are so like kind of hard to crack
0:42:29 and if we're allowing ourselves.
0:42:31 To go beyond the realm of like
deterministic, traditional software.
0:42:36 And like, we're using those
fuzzy materials a bit more.
0:42:39 And like we're thinking of like,
hey, if we're actually, embedding
0:42:42 them into our local software stack,
what becomes possible through this?
0:42:47 So like, just one way, for example is
let's say you're building a power tool and
0:42:52 like you have a very, very sophisticated
set of like system settings, et cetera.
0:42:57 Like for me, for example, the Apple
system settings come to mind and
0:43:01 they're really like, I don't think
they're the pinnacle of modern software.
0:43:05 And, I always need to use search.
0:43:07 And like five different things come
up and then it's like the 15th one
0:43:11 that I was actually looking for.
0:43:13 And like, it's just like very painful.
0:43:16 Now where we are so spoiled by like
using things like ChatGPT et cetera,
0:43:22 like it really feels like worlds a part
of like how good something could be.
0:43:27 So why not use something like a, ChatGPT
chat interface to interact with your
0:43:34 own app that like, you can, instead
of have to click the clock settings,
0:43:39 like why not allow your entire app to
begin configurable through AI models.
0:43:45 And so to make that actually happen
now you need to bring in like that
0:43:49 fuzzy LM piece into your software.
0:43:52 But like exploring that, like figuring
out best practices, figuring out
0:43:56 like how can you actually, constrain
that, that you don't, give the, users
0:44:01 so much, power that they can like
accidentally tear apart the app and
0:44:06 it's no longer functional, et cetera.
0:44:08 I think there's a lot
to be explored there.
0:44:11 So just as one area.
0:44:13 Another one is to give even more power
to the user or build systems in a way
0:44:18 that wasn't really feasible before.
0:44:20 We talked about the data interoperability
before data exports, et cetera.
0:44:25 Now we can actually build like
fuzzy bridges between different
0:44:29 software that were never meant
to be talking to each other.
0:44:32 Whether it's like in real time
or whether it's just like making
0:44:36 sort of, export interfaces a
little bit more ergonomic to use.
0:44:41 And now you could imagine whatever,
like using your, local supermarket
0:44:46 that might have like a certain,
online shopping, like not even API,
0:44:51 but just like a maybe connecting that
with your own home build to-do app.
0:44:57 And, there is not really like the
end all be all integration API, yet
0:45:02 you can make those things happen now.
0:45:03 So this is just like one of many, many
ideas where hopefully you all have
0:45:08 been exploring some interesting use
cases that we'd love to hear about.
0:45:12 So this is what comes to mind for me
about AI assistance for local-first.
0:45:16 Yeah, using these new technologies
to make the world more local-first,
0:45:21 especially maybe parts that
have been resistant to that.
0:45:23 I think breaking down data silos is one of
the biggest ones that's been such a long
0:45:27 running topic at you could switch with
projects like Cambria, but almost always
0:45:31 it involves kind of a convince everyone
to build their software on a completely
0:45:36 different stack, which sort of Yeah.
0:45:40 Is very much an uphill battle.
0:45:41 Right.
0:45:42 And as you point out, there's a
great agency in our personal lives.
0:45:45 I've experienced this already with, yeah,
being able to pull out, I don't know.
0:45:49 You know, there's some website that
has a list of things and I want
0:45:52 to put that into a spreadsheet,
but it doesn't offer a CSV export.
0:45:56 Okay.
0:45:56 I basically could do that with a
screenshot or a PDF and let the language
0:45:59 model do the hard work of, you know,
turning it into something coherent.
0:46:04 Similar idea there is just downloading.
0:46:06 I like to download my transactions from
my bank account on a quarterly basis, so I
0:46:10 have a record of that that's separate from
whatever clunky interface the bank has.
0:46:15 But inevitably, if you have a couple of
accounts and then they're all in slightly
0:46:19 different formats and trying to like
bring them all together into any kind
0:46:22 of unified ledger is nearly impossible.
0:46:24 It's just not worth the bother
for an individual or whatever.
0:46:28 But actually now with language model, it's
pretty easy to do an ad hoc thing where I
0:46:32 can go do the download effort myself once
a quarter, but then pull that all into a
0:46:36 spreadsheet with a normalized data set.
0:46:39 That feels very empowering for me.
0:46:40 It's like, okay, now I have all my
transactions in a place that I control
0:46:44 in a format that I want that isn't
dependent on, you know, my bank letting
0:46:48 me, you know, I go to login to download
something and it tells me, oh, sorry,
0:46:52 we only support transactions, you know,
back six months or whatever thing, right?
0:46:57 Very disempowering user experience
that instead it's something that data
0:47:02 that feels like it belongs to me, my
banking and transaction data, and I
0:47:06 have it in a place and a format that
I can control for the long term.
0:47:10 Exactly.
0:47:11 it's just so cool to see like how far
people take, like how much they embrace
0:47:16 the new forms of like, agencies that they,
I guess they, they've been always like
0:47:20 longing for, but now, like it becomes
feasible to, like really go for it.
0:47:25 And I think it's so, also so liberating
that you can build software for
0:47:29 yourself unburdened by like making
it enterprise grade, et cetera.
0:47:34 And so you can like, you know, I
need to hold it this way and it's
0:47:38 gonna work, otherwise it falls apart.
0:47:39 But that's fine.
0:47:40 And I think that's like the, beauty
of like building tools for yourself
0:47:45 and like local-first gives us the
glue that they actually can bear like
0:47:49 real weight and like work together.
0:47:52 So that is the new territories, which
I think is very related to the larger
0:47:58 ecosystem where we have, a set of
like other, very interesting topics.
0:48:02 So like some of them we've teased before,
but just to run through like on a high
0:48:06 level and then we can go into them
like again, we have like self-sovereign
0:48:10 identity, we have social media and
data ownership, encrypted messaging,
0:48:15 game development with local-first and
malleable software in the age of LLMs.
0:48:19 So maybe starting with the
self-sovereign identity, what
0:48:23 should people think about here?
0:48:25 Which sort of stories might we be
interested in having at the conference?
0:48:30 Yeah.
0:48:31 Well in general, this category of the
larger ecosystem is one I'm excited
0:48:34 about because I think there are so
many adjacent communities that are
0:48:37 interested in, yeah, for example, things
like freedom, you know, the open source
0:48:41 community, obviously the Linux world.
0:48:44 The Open Web and open standards, as well
as things like the end-to-end encryption,
0:48:48 kind of privacy, nerds out there.
0:48:51 You know, there's, that's not
exactly what local-first is
0:48:53 about, but it's very adjacent.
0:48:55 There's a lot of shared technologies
and things, and this is an invitation
0:48:58 for folks in those communities.
0:48:59 And I'm even sending out some emails and
so forth to folks to try to invite them in
0:49:04 to say, look, let's see where we overlap.
0:49:06 Let's, find the edges there.
0:49:08 yeah.
0:49:09 The identity topic though,
this is a big one for me.
0:49:11 It's something I've been
fussing about my whole career.
0:49:14 I have whole, article about it
in my making computers better
0:49:17 essay, from a few years ago.
0:49:19 But it basically boils down to, I
think the way we identify ourselves to
0:49:22 computers is kind of an embarrassment,
usernames and passwords, identity theft.
0:49:27 Now you've got, I don't know, magic
login links and login with Google
0:49:30 passkeys and whatever, and it's
just endlessly confusing for most
0:49:35 users and even for power users.
0:49:38 Yeah, the amount of time in my day,
I end up spite typing in two factor
0:49:41 codes and digging magic links out of
emails and just trying to convince
0:49:44 the computer that I am who I say I am.
0:49:47 And I know why it's that way.
0:49:48 Of course, as a professional that's
worked in this field and particularly
0:49:51 in the security, space, on and
off, over the course of my career.
0:49:54 But it really is a shame to me.
0:49:57 And then in the meantime, you have
this more and more control and
0:50:00 more and more ownership over our
identities that go to the companies.
0:50:04 And basically it's been a kind of
a good deal to say like, look, I'll
0:50:07 just let Google manage my identity and
then I can click the login with Google
0:50:10 button everywhere, because it is such
a hard problem and I can just kind
0:50:14 of outsource that to them, sort of.
0:50:17 But there, it's kind of like a little
bit of a deal with the devil there
0:50:19 comes with a lot of trade offs.
0:50:21 and local-first is a chance to,
rethink that, reinvent that.
0:50:25 and of course there are also
a lot of adjacent communities.
0:50:27 Things like Open ID for example.
0:50:29 We'll talk a little bit more about,
app proto and ActivityPub in a moment.
0:50:33 But they have their own concepts of
identity and how you give people ownership
0:50:36 over your online handle, in a way that's
sort of secure and safe, but doesn't
0:50:40 put the user in the position of needing
to manage a bunch of cryptography keys,
0:50:44 which they're inevitably going to lose.
0:50:46 so I think anyone working on anything
in this space, whether it feels
0:50:50 local-firsty or not, if you're working
with passkeys, if you're working
0:50:52 with, any kind of identity system,
yeah, we'd love to hear from you.
0:50:56 Yeah, I think this is a highly.
0:50:59 unsolved area.
0:51:00 I wouldn't say under explored.
0:51:02 I think, people are really exploring it.
0:51:04 It's a hard problem in
really interesting ways.
0:51:06 It is a hard problem and I think we've,
we've also come a long way already.
0:51:11 Like for example, like if you're
depending on, which pact with the
0:51:14 devil you've made, you can already
have a slightly more convenient life.
0:51:18 So me being, in pact with the Apple
ecosystem, I am very thankful for things
0:51:24 like Touch Id, et cetera, that are then
like nicely working together with things
0:51:29 like 1Password, Passkeys, et cetera.
0:51:31 and like being able to understand how
those things work and like thinking
0:51:36 through the implications, et cetera.
0:51:38 Like let's me be for, for this
point in time, in a relative sweet
0:51:41 spot between, like living a secure
life, but also having convenience.
0:51:46 But there's still like great
levels of like lock in, et cetera.
0:51:50 And I think this is also like all
of that aside, like we're now also,
0:51:55 having this like phase shift in
regards to software where we are no
0:51:58 longer the only ones who are doing
things on our behalf, with computers.
0:52:03 Like if we're, now whatever, like
maybe ordering, like some food or
0:52:08 we're doing some other things, maybe
we're, like scheduling something on,
0:52:13 the calendar or whatever it might be.
0:52:16 It's no longer just us, but there's
like another thing that needs
0:52:20 identity and even more fine grains.
0:52:22 And I think one aspect here as well
is like if you're going from beyond
0:52:26 authentication to authorization, so far
we have like, all off scopes, et cetera,
0:52:32 but like it's very all or nothing.
0:52:34 And it's all like, okay,
you, now get access forever.
0:52:38 But maybe for like those agentic use
cases, you might want to think about it
0:52:43 like, okay, you get to do this like one
time, or you get to do this like for five
0:52:48 minutes, or you get to do this like only
for this email address or for this scope.
0:52:52 So I think we want to make this like
much more fine-grained, but in a way
0:52:57 where you like, it's, it's frankly
like going through like the permission
0:53:02 granting on like a Google OAuth flow is
already overwhelming for most people.
0:53:07 And now making this
even more fine granular
0:53:09 Yeah,
0:53:09 I think is like really
0:53:11 tough challenge.
0:53:11 Thinking of a
0:53:11 giant
0:53:12 array of check
0:53:12 check
0:53:12 boxes on the GitHub, token generation
and there's a reason for it.
0:53:16 But then yes, again, that trade off of,
convenience and security is ever present.
0:53:22 I think it's that intersection
of like user experience
0:53:26 design and also cryptography.
0:53:28 Like how do you make it actually secure?
0:53:30 and I think that to, come together
in the best of both worlds.
0:53:35 I think that is like a area that's
like highly deserving of like
0:53:39 more resources, more investment,
more smart people working on it.
0:53:43 So if you're working on that,
we'd love to hear from you.
0:53:46 ideally where you cover quite
a bit of that intersection.
0:53:50 I think this is probably not
the best, conference to share
0:53:53 like your new breakthrough of
like some cryptographic nuance.
0:53:57 But I think where we can like bring those
two things together where you can also
0:54:01 with the focus of like, or one aspect
can be the solve sovereign, aspect.
0:54:06 I think it doesn't have to be
a prerequisite, but I think if
0:54:09 something points in that direction.
0:54:12 And also I think another, tricky part
here is like that we need to kind of
0:54:18 create a bridge from like today, where
people are like, defacto using things
0:54:24 like login with Google, et cetera,
because it strikes A, acceptable balance
0:54:29 of like convenience and security.
0:54:31 And if there's like a much to esoteric,
version out there that doesn't have a
0:54:36 credible path to becoming mainstream,
I think that also is something that
0:54:40 needs to be taken into consideration.
0:54:42 So this is a very nuanced
topic and I think as one of
0:54:46 the harder nuts to crack here.
0:54:48 but if you're working on that,
we'd love to hear from you.
0:54:51 And I think with that it is like a
natural transition to, things like
0:54:56 BlueSky ATproto where we talk about,
social media and data ownership.
0:55:01 So you've already mentioned initially.
0:55:04 That Martin Kleppmann is affiliated with
the ATproto ecosystem, and I think that's
0:55:10 just like one example for a broader,
set of design challenges and like goals
0:55:16 that I think is like nicely adjacent or
partially overlapping with local-first.