Skip to main content
 

Defense against the digital dark ages

Vint Cerf speaks today at noon! Via VC or in MTV-1950

_We create digital content in enormous and growing quantities every day. Much of this content requires software to be displayed (images, videos) or manipulated (e.g. spreadsheets and text documents) or executed (e.g. video games). In some cases, specific operating systems and hardware are needed for support. We face a challenge to preserve digital content over periods of hundreds or years because the software and associated hardware may no longer exist. There are legal issues associated with copyright of content and licensing of software as well as business models that must somehow be sustained for long periods of time. This talk will outline some of the challenges and possible solutions._

https://liveplayer.googleplex.com/view/2016-10-27-43705620-31

Location: MTV-1950-1-Bodega Bay Tech Talk

Reserved VC rooms:

RES-EXPL-10-Mount Rogers
NYC-9TH-15A239-Raft of Otters
DUB-1GC-4-Fangorn
This talk will be recorded

 

 

Needed to fire up an Etherium test node so I thought I'd give Azure a shot since they have a nifty dev-labs tool built for it.

Pretty nice. I had a VM up and running with 00 credit in about 15 minutes, even with recovering my live.com password account.



https://azure.microsoft.com/en-us/






 

Weekly GFE pushes? What year is it?






 

As I said on http://g/opensource-discuss :

_We’re Google. The 10x solution is to replace DNS. (And I’m only half-joking.)_







 

Did someone say DNS DDoS Attack? Remembering PharmaMaster vs Blue Security, 2006

Blue Security Graph

Yeah, I was there... Back in May of 2006 Typepad, LiveJournal and TuCows got taken down by a massive (at the time) DDoS.  I recall it was 2-4 GBps of reflective DNS traffic.  Scott Berinato covered it pretty well in the Wired article Attack of the Bots.

For the record we were able to get back up using Akamai DNS Hosting, MCI/UUNet DDoS mitigations, and a cleverly placed GRE tunnel.  Oh and a bunch of great Ops work from Lisa Phillips, Matt Peterson, Peter Wohlers and others.  I think I still have the commemorative t-shirt we did with TuCows.

And here we are 10 years later.  Same stuff, yet in many ways worse.

It's high time we get to fixing the underlying protocols and infrastructure to make these types of attacks a thing of the past.  It's time to Redecentralize.

 [Fancy graph from: Netcraft, Blue Security Shuts Down, Citing DDoS Attacks]

 

 

Releasing this under Affero GPL LICENSE would have been an epic troll.


https://opensource.googleblog.com/2016/10/introducing-nomulus-open-source.html#__sid=md1






 

20% project Idea

Create Google+ Communities based on donation match data from https://give.corp.google.com/b

Then expand that further, let anyone make communities with a recurring membership fee, or private profiles with a membership. Sort of like Patreon.. but better.










 

Long Now

Would people be interested in attending a *Google Talk* about the *Long Now* projects 10,000 year clock[1] and Rosetta disk[2]? I'm in touch with their staff and they expressed interest and I'd like to know if it's worth my time to organize the event...

Also I recommend joining and attending their events. Lots of interesting people and viewpoints that you normally don't get inside the tech bubble. Plus it feels like you're a member of a secret society and their bar _The Interval_[3] serves up damn fine cocktails.

[1] http://longnow.org/clock/
[2] http://rosettaproject.org/
[3] http://theinterval.org/

http://longnow.org/about/

 

Am I the only that's shocked that GFE pushes are paused for over a week?

If so I hope that people point out how much of a SPOF this is. [And maybe we'll finally be able to open the huge urlmap.production.any in cider without problems]




https://groups.google.com/a/google.com/d/msg/prod-notify-all/QuvZJiC0TKc/io_-O0nCAgAJ






 

Found some weekend reading based on the abstract alone.


_Although it has been a part of the dark underbelly of the Internet since its inception, recent events have brought the discussion board site 4chan to the forefront of the world's collective mind. In particular, /pol/, 4chan's "Politically Incorrect" board has become a central figure in the outlandish 2016 Presidential election. Even though 4chan has long been viewed as the "final boss of the Internet," it remains relatively unstudied in the academic literature.
In this paper we analyze /pol/ along several axes using a dataset of over 8M posts. We first perform a general characterization that reveals how active posters are, as well as how some unique features of 4chan affect the flow of discussion. We then analyze the content posted to /pol/ with a focus on determining topics of interest and types of media shared, as well as the usage of hate speech and differences in poster demographics. We additionally provide quantitative evidence of /pol/'s collective attacks on other social media platforms. We perform a quantitative case study of /pol/'s attempt to poison anti-trolling machine learning technology by altering the language of hate on social media. Then, via analysis of comments from the 10s of thousands of YouTube videos linked on /pol/, we provide a mechanism for detecting attacks from /pol/ threads on 3rd party social media services._


https://arxiv.org/abs/1610.03452






 

All-in on Ubiquity

Turned off my HP workstation for the last time.

You can get 6CPU, 32GB mem, 300GB disk hosts these days. They're actually pretty decent for most work. You lose hyperthreading but you get 46MB cpu cache. I/O feel relatively snappy.

Get your own https://portal.corp.google.com/

Of course I look forward to the day when all of this runs on GCE and I can remount my block device on a n1-highmem-32 (32 cpus, 208GB memory !!)









 

New Kill Oz Theme songs.

Sadly out of print, but was able to buy this on vinyl over on eBay...



http://petdance.com/nr/discography/comps/busted-at-oz/






 

@NLAPandora @internetarchive Thanks to @jgoerzen there's a 2007-era archive of gopherspace at https://t.co/2CtFKcT5LJ

 

Code Next Opens in Oakland, creating diversity through Constructionism

Code Next Opens in Oakland, creating diversity through Constructionism

"From a design point of view it is a truly unique experience that very much leans on an educational theory known as constructionism. This codified curriculum will soon be available to the entire world as an open source."

 

The Whiz Kids - Tech Role Models of the 80s

Reading this passage from Ready Player One1 I was reminded of a major influence that I had all but forgotten:

It was a Friday night, and I was spending another solitary evening doing research, working my way through every episode of Whiz Kids , an early-’80s TV show about a teenage hacker who uses his computer skills to solve mysteries.  Ready Player One, Ernest Cline, Chapter 18.

So I was prepared when I was recently asked "What brought you here?" (in relation to technology). My answer? ... The Whiz Kids. I can directly trace my interest in online services to that white-hat hacking, war dialing, speech synthesizing, BASIC programming gang of kids2.  I can only hope that today's teens have something as good or better.

Trying to find the video also made me realize that Youtube is providing a vital preservation service.  You see the Whiz Kids episodes were never released, not on DVD, not even on VHS. You won't find them in any library. Anywhere. But there it is, in 10 minutes chunks3, captured and uploaded off a grainy, noisy videotape recording.

Cultural Artifacts, preserved... for now.


  1. RP1, soon to be a major motion picture from Steven Spielberg.
  2. It was also probably the first time I ever heard about the NSA ("No one knows if they even exist")
  3. Here's a full Full Playlist
Image from IMDB
 

1m LoC deleted!

Of course I couldn't have done it without the entire teams that wrote the code and these specific products:

Firefox Toolbars
Google Gadgets, iGoogle, and OpenSocial
Hotstuff
Google Buzz and the entire Focus Frontend
Chili
Tacotruck
Mercury
Kraken
... and Oz

And big shout outs to abandoned experiments, never completed features and my agent, Klippy.

https://deletestats.googleplex.com/plindner#1286694000..1474786800!cdd

 

Me, At Conference. _*Oh, I work for Google*_ .... space time warps.

Next time I might just use a fictitious company. If we can agree on a secret name Googlers can just nod understandingly when I say "Oh, I work for Massive Dynamics".



http://www.siegelgale.com/brand-naming-8-great-fake-company-names/






 

Where's the schema.org markup? Where do I file bugs?

Guess I should just be happy that there's an RSS feed here... https://blog.google/rss/


https://blog.google/






 

 

I'll be at this thing today. Will take notes and have a post trip report.


https://longnow.org/events/02016/oct/04/long-now-member-summit/






 

A reminder from Vint Cerf about the importance of digital preservation

A reminder from Vint Cerf about the importance of digital preservation

It seems inescapable that our society will need to find its own formula for underwriting the cost of preserving knowledge in media that will have some permanence. - vinton cerf  - We're Going Backward

I've seen this firsthand. Albums from some lesser known bands I listened to in the 90s are not available in digital format. When the CDs finally bit rot the music will be gone forever unless someone rips and uploads them. Some content never made the jump from VHS, also at risk of loss when the tapes degrade.

Support the Internet Archive and other efforts if you value this. Also work towards a future self-archiving decentralized web where content can live beyond the data silos they currently occupy.

 

 

 

Finding is somewhat ironic that the project to turn down Oz is called Deathstar. Past project G+ names included *MorningStar* and *NorthStar*

Oh and the follow on _Falcon_ project is aptly named, as you can see below...







 

Chat bugs

Reported a bug in Matrix chat. Bug filed.... Via chat.

Wish Hangouts group chat had this...

Of course we could do this for G+ too. Plus mention a magic page named +Buganizer on a post and you'll get a bug filed.. Problem is that syntax errors are harder to process...

 

Feature Request

Google Webmaster Tools lists links to all Chrome extensions that reference your domain...

Not sure which category id...

 

My new favorite way to manage home directories with git

My new favorite way to manage home directories with git

And you can avoid merge conflicts by adding entries to your .gitattributes file:

.bash_history merge=union

Original: http://www.1500wordmtu.com/2016/my-new-favorite-way-to-manage-home-directories-with-git

 

 

Added a new ubiquity instance recently. I'm happy to say that I've moved my home directory to a git repo. For internal usage git on borg is a good choice.

gob-ctl create user/lindner/dotfiles
cd ~
git init
echo "*" > .gitignore
git add .gitignore
git commit -m "initial commit"
git remote add origin sso://user/lindner/dotfiles
git push -u origin master

The trick I mention below for append only files also works for .dremel_history



http://www.1500wordmtu.com/2016/my-new-favorite-way-to-manage-home-directories-with-git






 

Did Someone say *Megadeth*?

So I had to laugh at the Events Demo using Megadeth. Back in the day we used email to coordinate our outings.

\m/ forever!

Oh and I ended up losing my glasses and contracting a skin infection. Totally worth it.

_>From the farthest reaches of the net, [email protected] said:_
_._
_> so... dread is little more than 24 hours away. what are your bags?_

_Sorry folks, can't make this one, was really considering it, but......_
_databases calling and this other ton of work....._

_> let us move this email through, doodz, so we do not leave anyone out of_
_> this most excellent event (well, besides motorhead and metal church on_
_> the 4th of june at first ave, and the "clash of the titans" with
. slayer, megadeth, and anthrax on the 9th at Trout aire ;)._

_Say does anyone need a ticket to the clash of the titans. I bought_
_four, so far three are spoken for. Since it's general admission It_
_doesn't matter where you get your ticket, just as long as you get it._
_I also have room in my 79 Duster Partymobile for one more passenger._

_So who will it be? Who's brave enough to mosh it up with me?_

_See ya in the PIT!_



https://www.youtube.com/watch?v=JoFRpvYyY7Y






 

@colemickens Never doubt that a small group of thoughtful committed citizens can change the world; indeed, it's the only thing that ever has

 

Social Network Standards...

A look to the past to guide us towards the future. This is a candid, level headed, and enjoyable talk about the way we've failed users.

_Harry Halpin and Blaine Cooke go through the history of standards for social networks and identity, and why they failed._

_The Augmented Social Network_ [1] 1995
RDF/FOAF
EmotionML
RSS -> Atom -> ActivityStreams
XRIs
XMPP
OpenID
OAuth
OpenID 2.0
OpenSocial
PubSubHubbub/Salmon
OpenGraph (HTML for Facebook)
ActivityStreams 2.0 (W3C Social)
Blockchains

[1] http://journals.uic.edu/ojs/index.php/fm/article/view/1068

http://redecentralize.org/conf2015/2016/09/07/13-ten-years-of-standards-failure.html

 

Slack no more. Why you should use Riot.im and Matrix.org

There's been a trend where open source projects start a Slack for team communication.  I understand why.  The Slack UI is refined, you get searchable, synced conversions on all devices and even emails when you're away.  Nice!  Except the price you pay is vendor lock-in and a closed source code base.  Plus aren't you fed-up with creating dozens of slack accounts for each projects?  I know I am.

What if I told you there was an open alternative?  One that even included access to your favorite IRC channels? Well there is.  For the past month I've replaced Slack usage with Riot.im (aka vector.im) and Matrix.org and I am very, very happy with the results.  

Let's start with the UI.  Here's my Web UI right now:

 

 

On the left: rooms/channels. I've customized mine into high/low priority with full control over notification settings.

In the middle: the  IRC channel on Freenode.  Read/unread state is maintained on the server so I can easily switch to the Android or iOS app and participate there.

On the right: the member roster.  You can hide it, or use it to Initiate direct messages.

And look, here's the same UI, on Android showing the Matrix HQ Room:

As you can see Riot supports video/audio calls using WebRTC and file upload too.  Works really well!

Did I mention that these super high quality clients are all open source?

So what about the underlying service?  Well, we're in luck.  The matrix.org service is also well designed, fast, interoperable and open.  So what exactly is it?  From their FAQ:

Matrix’s initial goal is to fix the problem of fragmented IP communications: letting users message and call each other without having to care what app the other user is on - making it as easy as sending an email.

The longer term goal is for Matrix to act as a generic HTTP messaging and data synchronisation system for the whole web - allowing people, services and devices to easily communicate with each other, empowering users to own and control their data and select the services and vendors they want to use.

Bold and ambitious, and the FAQ has answers to some common questions like why not XMPP and more.

What all this means in practice is that anyone can run Matrix protocols using their own servers.   Want your own private internal system?  Run your own server disconnected from the network.  Want your chats to stay on your own server?  Run your own; with the benefit of interoperating and communicating with other servers in the mesh.  Want to bridge to another chat system, like IRC?  Yes, you can.

And the IRC integration is very, very good.  As you saw above identity and channel state is carried through, direct messages are supported. Offline for a while?  Scroll back to your unread indicator.  Or just check your email:

A Matrix notification shown in an email browser window

So there you have it.  An open system that enables chat.  A highly polished front end.  Full support for one to one and one-to-many conversations. Yes, it's beta, so there are some rough edges.

Give it a try.  You can find me at @lindner:matrix.org or just drop into some IRC channels, my nick is plindner.

 

 

Just finished the six part documentary Capitalism. Feels like the 1st time I read The Peoples History of the USA. Oh and

http://capitalism.vhx.tv/

 

I have invites to keybase.io Making PGP usable and secure is one of those unsolved problems in our industry.

 

Verifying myself: I am lindner on Keybase.io. _Kcocxbmcc1pj8ngCaOpcdL8rDT2Jmx7uxBf / https://t.co/TVOuATAgoj

 

How easy is it to learn Verilog, VHDL and Lua? Only 3 languages until I hit Yoda.

[Oh and I have no idea what the Spitfire language is, but I'll take it...]




https://docs.google.com/document/d/1B9I1kEps589lHhpzsUIecAmJWgNb-H1cj1qspdXQJ_c/edit?_escaped_fragme...






 

 

1500 Word MTU has a POSSE: Week 2 Update

I'm still pretty happy my indieweb publishing experiment.

Content is flowing in all the right ways.  Posts end up as Posts.  Photos are uploaded native with backlinks. POSSE via brid.gy just works.  You can see that Brid.gy polls Google+, and then saves what it finds back to the original post by sending Webmentions.  The result is a full archive of activity around this content.

Oh and cross posting to SoundCloud worked perfectly.  And so do embeds..

 

After a fix from the Known Team WebHooks are working.  I get a POST whenever content changes.  To test this out I send the URL to the Internet Archive Save Page.  Voila!  Instant archiving of my content.  [Next up, backups in IPFS]

I was able to set up the Known open source software on my own server.  Next step is to pull a backup from the hosted version I'm using so I can experiment further and contribute back to the project.

Mobile Posting via Chrome on Android is working well.  You can access the Camera and a rudimentary file picker.  HTML editing is workable, but not great.  I installed the Url Forward app so I can also have native sharing intents.

 

Bumps

Of course there are some issues encountered...

Spelling errors mean you Publish Once, Edit Everywhere.  Or if you messed up the URL, Publish Once, Delete Everywhere

I tried using a native web mention to reply to another post, but it didn’t appear on the target site.  There wasn't any visible UX feedback.

I found that there’s no UI support for backdating posts.  Okay, I’ll try Micropub to post.  Nope, very rough implementations, but Quill seems nice.  Eventually I wrote a stub post in Wordpress, exported, imported and edited.  Phew!

But.. it appears that brid.gy doesn’t syndicate to old posts like this.  Even when I went back and pointed links at each other.  I’ll have to followup on that.

Also, I lost the first version of this post due to a CSRF error since I left it sitting too long in the browser.  Oops.

TinyMCE still is a pain and loves using &nbsp; and CMD-9 is bound to <address>..   I might have to use Markdown instead.

I miss @ mentioning people, and wish there was a UI for that.

Native Google+ support in brid.gy needs an API.

 

But still overall quite happy with the way this is going.  I hope you're enjoying the journey with me.

Tagged:

 

Ever wanted to send a postcard to a prod server?

*mdbsql*> select datacenters.region, datacenters.primary_purpose, datacenters.value, buildings.name, buildings.streetAddress from datacenters, buildings where datacenters.building_id = buildings.id an
d buildings.country = 'US' and datacenters.state = 'active' and datacenters.primary_purpose = 'production';










 

Achievement Unlocked*: Impersonated on Facebook.

*Good*: Facebook killed the profile 2 minutes after I reported it for impersonation. Also a great way to get in touch with old friends as they ask 'was that you?'.

*Bad*: the grammar.

*Ugly*: 19 people had friended that profile before it was taken down.

Be vigilant out there....

https://plus.google.com/photos/107786897865850743842/albums/6325073859824754257/6325073857645853762?...

 

What year is it?

Handwritten in pencil.

Yours truly,
Paul

 

 

_IPFS - Content Addressed, Versioned, P2P File System_ - Research

Pretty well written paper that covers the basics of IPFS.


https://raw.githubusercontent.com/ipfs/papers/master/ipfs-cap2pfs/ipfs-p2p-file-system.pdf






 

Best go link of the day:

http://go/gaia-hates-rpcreplay

a little humor softens the pain of having to regenerate those rpc logs....









 

 

I made a spelling error on a post... I think.....

*Derpecation*











 

First FinTech, now *AgTech*...

Another8 is a recruiting firm that partners closely with venture capital firms including Google Ventures, Kleiner Perkins, Andreessen Horowitz and others. Our clients hire us as an in-house resource and also on a contract basis. After reviewing your LinkedIn profile we felt you could be a very good fit for a few of our clients. Your time at Google is very interesting.

See Jane Farm (www.seejanefarm.com) is a hyper-yield AgTech firm making amazing produce possible with a 99% smaller water footprint, 50% lower methane (greenhouse gas) and waste footprint, and a 350x leap in per acre yields.
- Over 5.5 million in first official round of funding
- Google’s kitchen was our first customer and has been using our produce for the past year
- We’re working to use 99% less water than the industry that now uses 70%+ of the world's water.



http://www.seejanefarm.com






 

My credit union uses Broccoli Man for their credit card activation IVR system.