Introducing the Encyclosphere

This is the text of a speech I gave yesterday (October 17, 2019) at TheNextWeb’s Hard Fork Summit in Amsterdam.

For now, you can go to Encyclosphere.org to sign up for news of the project. We’ll also give you opportunities to get involved within the next week or two.

Update: I’ve added a video (produced later, after giving the speech).\

Update 2: This speech is included as Chapter 10 of my 2020 book, Essays on Free Knowledge.


Here’s a video of the speech.

We are fed up.

After ten years of domination by big social media—which might finally be in decline—we are tired of giant Silicon Valley corporations using us contemptuously. We still remember an Internet in which we charted our own destiny and owned our own data.

It’s not just social media. It’s Wikipedia, too. If you want to participate in the world’s largest encyclopedia, you must collaborate with a shadowy group of anonymous amateurs and paid shills on exactly one article per topic. If you’re new, you won’t be treated very nicely. If you don’t play their strange game, you’ll be summarily dismissed. Like the social media giants, Wikipedia has become an arrogant and controlling oligarchy.

Like Facebook, Wikipedia is also controlling its readers. It feeds them biased articles, exactly one per topic, does not let users give effective, independent feedback on articles (you’re forced to become a participant if you just want to give feedback) or to rate articles. They have, in a very real way, centralized epistemic authority in the hands of an anonymous mob. This is worse than Facebook. At least with Facebook, Congress can call Mark Zuckerberg to testify. There isn’t anyone who is responsible for Wikipedia’s content—certainly not Jimmy Wales. The situation is, in some ways, more dire than with Facebook, because you can’t effectively talk back to Wikipedia.

The old proverb tells us that knowledge is powerful. More specifically, authoritative statements of what is known on various subjects are powerful. How? Such statements can be used to influence elections, justify policies, and articulate controversial points of view—in effect to gain, wield, and build and consolidate power. The power to declare what is known is nearly the power to rule the world. No small group—no person, corporation, oligarchy, or cadre of insiders—should wield such power.

We believe in democracy: we believe that political power is best spread out, not concentrated in the hands of a few, where it is apt to be abused. We should also believe, therefore, in epistemic democracy: the power to declare what is known should also be very widely distributed.

So it should not be concentrated in the hands of Wikipedia, Facebook, Twitter, The New York Times, or any such exclusive group. The history of publishing, including Internet publishing, makes all too clear that the authority to declare what is known is wielded by selfish, powerful interests to advance their own agendas, which always unsurprisingly have the effect of consolidating their own power.

We don’t have to tolerate this. We don’t have to be at the mercy of these people.

A few thousand people work regularly on Wikipedia. But what if millions more—orders of magnitude more than are working on Wikipedia—wrote encyclopedia articles and rated them, as part of a completely decentralized knowledge network, with no individual, group, corporation, or government in charge of the whole? That is surely possible. There are surely that many people who, if given the freedom to do so, would be highly motivated to volunteer their time to add to the world’s largest collection of knowledge.

We could create a knowledge commons, defined by neutral, open, technical standards and protocols: a network that decentralizes encyclopedias, exactly as the Blogosphere has done for blogs.

The Encyclosphere

Blogs give everyone an independent voice. All blogs taken together are called the “Blogosphere,” but there is no single, central blog repository and no blogging authority. It’s a good thing, too. Can you imagine what it might be like if all our blogs were ultimately controlled by a giant, powerful organization like Facebook, Twitter, or Wikipedia?

What made the Blogosphere possible were technical standards for formatting, sharing, and interlinking blog posts: the RSS and Atom specifications. The nontechnical basics about these standards are easy and important to understand. They are simply a way to format info about blog posts in a consistent, machine-readable way, and to let bloggers alert the world when their blog has changed. In general they allow for an organized type of interconnected, networked activity—blogging—without a central, controlling body.

Plenty of websites, like WordPress.com (currently the leader according to Alexa.com), Tumblr, Medium, and Blogger.com, have tried to become the home of blogging online. But none has been able to gain exclusive dominance, because it’s just too easy to move your blog elsewhere. The existence of common blogging standards makes that possible.

We need to do for encyclopedias what blogging standards did for blogs: there needs to be an “Encyclosphere.” We should build a totally decentralized network, like the Blogosphere—or like email, IRC, blockchains, and the World Wide Web itself. The Encyclosphere would give everyone an equal voice in expressing knowledge (or claims to knowledge), and in rating those expressions of knowledge. There would be no single, central knowledge repository or authority.

So, considering that RSS and Atom enabled the development of the decentralized Blogosphere, we clearly need to develop technical standards for encyclopedias. That is the mission of a new organization I want to introduce: the Knowledge Standards Foundation. (Note, the website of the future Foundation will be Encyclosphere.org, while our Twitter account is @ks_found.)

Writers and publishers would be able to post feeds of encyclopedia articles (or metadata about articles, and ratings of articles). App developers would be able to collect the data from all of those feeds and use the data to construct massive search engines, and other neat features, for all the encyclopedia articles in the world. No one app would be privileged, but all would tap into—and help build—a “knowledge commons.” Ultimately there would be a massive knowledge competition to best express human knowledge on every topic and from every point of view.

There’s never been anything like this. But if we get together, we can build it. Nobody’s stopping us. We need only the desire to get it done. We’ll never run out of runway because it’s not a startup. It’s a distributed, collective project, an open source movement that is bigger than any of us—and certainly much bigger than the Knowledge Standards Foundation, which will serve only as the catalyst, not the owner. The Encyclosphere will have no owner just as the Blogosphere has no owner.

Epistemic power should be spread out among the public. But how? I call it the “Encyclosphere,” but how would a more democratic Encyclosphere work?

  • Writers should be able to publish their own articles wherever and whenever they want, without asking anyone.
  • Raters—the general public, including people identified as experts—should be able to rate those articles.
  • The data for both articles and ratings are published according to standards, or a single common format, in a feed, similar to an RSS feed.
  • Users should be able to sort and re-sort articles according to all ratings, or selected ratings.
  • The control over whose ratings to pay attention to should always be in the hands of the user.
  • The data is slurped up and aggregated into different databases, including distributed databases such as IPFS, and open APIs.
  • Many competing apps, all around the world, use the aggregated data to build encyclopedia readers according to their own editorial standards. The Foundation’s technical standards will be completely neutral with regard to such editorial standards.

This is not a completely new concept, but I’m sure it will sound somewhat confusing. So I want to try to clarify by listing a few things that the Encyclosphere is not, or will not be:

  • The Encyclosphere is not an encyclopedia. It’s a network of encyclopedic content. It’s no more an encyclopedia than the Blogosphere is a blog.
  • The Encyclosphere is not a platform or network for building encyclopedias. It will be basically just a series of feeds. It’s not a piece of software or a library or API you can build on. It’s an old fashioned Internet network.
  • The Encyclosphere is not a blockchain. You could put it on a blockchain, sure, but it will be built directly on the World Wide Web.

By building the Encyclosphere, we, all of us little people, can, in a decentralized and democratic system, do an end run around giants like Google and Wikipedia.

The Knowledge Standards Foundation

This is the vision I’ve had for encyclopedias since around 2014. That was when I first started talking about something I called “GreaterWiki”; I even started learning to code more seriously partly in order to execute the vision. I went to work for Everipedia, the blockchain encyclopedia, in late 2017 with the promise that I’d be able to work on this project. When I joined the startup (three years after the co-founders began work on it), one thing we discussed would be the necessity of creating a nonprofit organization holding technical standards for encyclopedias. I thought that heading up such a foundation was a job I’d like to have.

For almost two years, I’ve been developing and promoting this vision (and related ideas, like decentralizing social media) as CIO of Everipedia. I’m grateful to Everipedia for the opportunity to develop and share the plan. But now it’s time for me to get to get serious about actually executing the plan. And for that, I’ve decided to get that independent foundation started.

Therefore, I am announcing that I have left my position as CIO of Everipedia to start a new Knowledge Standards Foundation. To demonstrate that the Foundation and Everipedia are independent entities, I have given back my equity to Everipedia—without compensation, i.e., they didn’t pay me for my returned equity and I did not receive or cash in any IQ tokens.

Everipedia has already committed to being among the first or the first to use the open standards that the Foundation develops, and I will continue to work with Everipedia’s technical team—along with other reference publishers and the general public.

The Foundation’s purpose will be to publish technical standards for the Encyclosphere. We will host open source tools and other software mainly for the developer community. And we will serve as a neutral public forum for discussion of such standards. We will be mostly a volunteer organization. Already over 40 people have stepped forward to help. I expect many more volunteers in the coming months.

There are also a few things that the Foundation is not, or will not be doing.

It is misleading to call the Encyclosphere “a project” of the KSF, insofar as that implies a centralized development project. We just want to be the organization to get the ball rolling and to articulate the encyclopedia specification.

The Foundation is not itself developing an encyclopedia. There will be no KSF Encyclosphere reader. We want there to be lots of competing reader software, just as there are competing blog readers.

The KSF is not an industry consortium; it is not a project paid for and controlled by reference publishers. I will have an announcement about how we’ll raise money for our modest operations next month.

I and future Foundation staff and volunteers will confer with the leadership and technical teams of a number of different app developers, standards experts, online reference publishers, and other potential stakeholders—including, of course, anyone from the interested general public. We will develop draft standards together, while vetting them in a very public, open, civil, and moderated process. As we develop software, we will host it in a Git repository controlled by the Foundation.

If you are interested in learning more, or even getting involved at this very early stage with the Encyclosphere project, please go to Encyclosphere.org and add your name and email address to our mailing list.


by

Posted

in

Comments

Please do dive in (politely). I want your reactions!

42 responses to “Introducing the Encyclosphere”

  1. […] to best express human knowledge on every topic and from every point of view,” Sanger described in a speech last […]

  2. […] solution is “The Encyclosphere,” which was announced in October of 2019. In a speech given at TheNextWeb’s Hard Fork […]

  3. I have in mind a detailed comment about why blockchains will still be necessary for your desired outcome. I have also been working on this concept since ~2014 as well. I am a life long programmer roughly your age as well.

    I first want to ask if you are receptive to my comment before I apply the effort to compose? I hate wasting effort and being censored.

  4. […] in addition to his own consulting firm. (Sanger now hates Wikipedia, which he known as in a blog post final yr an “conceited and controlling […]

  5. […] Sanger, who co-founded Wikipedia in 2001 before leaving the project, is describing his Encyclosphere as a networked aggregation of existing and new encyclopedia content, which will be distinguished […]

  6. R.O.

    One thing to consider is keeping the integrity of the content. There was an attempt years ago called “Wikinfo” that tried to deal with the bias of Wikipedia by having pro and con articles about controversial issues. But they had no way to prevent people from adding their own edits to articles written by others. It was bad enough when pro people edited con articles, or visa versa, but the hardest ones were where people added often irrelevant beliefs that ruined the integrity of the information as intended by the original author.

    There are two ways I see to deal with this problem: make the original article immune to edits, but
    1) have pro and con articles linked in some way, so that a reader can get both sides
    2) have a comment section after each article, where people can add their comments.

    1. If you read the blog post, you’ll learn that the encyclosphere is not going to be an encyclopedia. It is going to be an encyclopedia network, which is another kettle of fish.

      It will make it much easier for people to find articles on the same topic from multiple points of view.

  7. Alexander

    Looking forward to it.

  8. Carla Rogers

    Larry,

    I could be mistaken, but it seems that no matter what rules bound the encyclosphere, it will always be possible for a mob to control it or discredit it the same way Wikipedia is controlled and Gab is discredited. Aggressive people always can dominate public repositories using the rules to achieve their objectives. Since users-at-large will always devolve to empire building, public repositories cannot be neutral. The system will have some mix of mob-bias or bias of the system administrators, who have powers not held by the public. This is a law of human nature and language.

    The best solution I have seen is how development of the Debian distribution of Linux is managed. The public is able to participate, but there is a build manager with all power, elected by other developers, to serve only temporarily, so no one hand controls forever. One of the reasons this works so well is Debian got one of the most magnificent foundings, when a gifted developer started the distribution and the process used for developing it.

    Perhaps you shall be the great founder of the Encyclosphere who initiates a system and development process that can out last your role as leader. The Encyclosphere will devolve into the same mess as the rest of public media unless the system has a wise, skillful central editorial authority with privileges that override the impulses away from tghe public mob. No one can be genuinely neutral, but some are better at it than others by a lot. The Enclyclosphere will succeed in its goal of neutrality only if it is run by a succession of editors or editorial teams with a useful perspective on what neutrality is.

    HOW DID WIKIPEDIA GET OFF THE RAILS ON THE LEFT SIDE?
    Looking again at Wikipedia, I am not sure how well it is known that Wikipedia has developed a phenomenonally complete and ingenius scheme for managing public content. I am referring to the
    .. policy on Neutral point of view
    .. policy on Verifiability
    .. policy on reliable, published sources
    .. Guidelines for andling of bias on Wikipedia,
    .. and many others.

    It is hard to see how those processes have failed to prevent the site from getting off the rails on the left side. The problem might be as simple as the personalities of people inclined to participate, or, more likely, the result of secret fortunes poured into paying contributors to drive a left perspective into Wikipedia. The rules for correcting Wikipedia are in place. Attempts to apply the rules fail, because non-left points of view are outnumbers by such margins progress is very slow. I battled for a few sentences to find their way into an article about the assassination of John Kennedy. I beat the lefties in this one tiny battle, in one section of an article related to the assassination, but the ol’ “Oswald did it” narrative is about all you can find in Wikipedia on JFK’s murder. It would take a lot of smart, trained, hard working contributors years to make a serious dent in correction Wikipedia.

    ENCYCLOSPHERE’S CHANCES OF CREATING STABLE REPOSITORY OF NEUTRAL TRUTH
    There is no chance of the Encyclosphere avoiding the same fate unless editorial control overrides are retained by you and people you select and monitor. I am interested in learning of any disagreement you might have on this. To me this seems to be inherent to the dichotomy of system control. You either control it or you don’t and if you don’t malicious forces will destroy it. God could change that, but a human cannot. If you want others to build the system you want, you won’t get the system you want.

    TEST CASES
    Our civilization is sinking in the body of lies filling our Ministry of Truth in the form of the Internet. We must have better coverage. Here are some subjects that can be used to test the neutrality and truth of any body of world knowledge.

    There is no proof that vaccines do not cause autism or that vaccines are not the cause of the climb in autism rates.

    The role and objectives of the Cecil Rhodes Round Table groups in orchestrating the commencement of World War I.

    The fact that Lee Oswald did not kill Jack Kennedy working alone. There is more evidence of a bullet hole in the windshield from a bullet fired from the front than there is that Oswald fired a gun that day.

    Former Attorney General William Barr, a CIA operative using the alias Robert Johnson, and Bill Clinton met with other CIA operatives in Arkansas in 1987 to manage ongoing drug, cash, and arm smuggling in and out of Latin America.

    The Oklahoma City bombing was an operation in which the FBI played a lead role in perpetrating the event. Tim McVeigh was hired for his role, which was a patsy role. Two bombs were inside the Murrah building, one of which went off and caused most of the damage. The Ryder truck bomb could not have caused the pattern or extent of damage. Seizmic recorders measured two blasts. The other bomb inside the building was found by an officer on the scene who was murdered later. The unexploded bomb inside the building was announced on live TV news broadcasts in the minutes after the blast. Those recordings are available today. Am implication is the United States government has no problem conducting mass killings of innocent bystanders to achieve its strategic objectives, even when the strategic objectives are petty, such as the objective of destroying or stealing records regarding the Clintons and Whitewater.

    Military-grade nano-thermite was found in significant quantities in the dust from the collapse of the Twin Towers on September 11, 2001. This was the result of the collapses being caused by thermite placed into the buildings over a period of months before the event. Financial transactions made just before the event show foreknowledge of what was coming. One of the beneficiaries of these transactions was Neil Bush, President G.W. (“Chimp”) Bush’s brother. Bin Laden was known by the United States to have been hiding in Iran for most of the time between 2001 and 2011 when he was moved to Pakistan in preparations for his assassination, which was staged using information quite different from the mainstream narrative.

    There is plenty of evidence justifying suspicion that Biden’s election was no where near fair and square. Zealous denials and accusations that those with such suspicions are terrorists create grounds to suspect even worse.

    CONCLUSION
    Unless you personally manage the Encyclosphere on these subjects, these truths will not be supported. Unfortunately, if you make sure support for these truths is sufficient for proper presentation, the Encyclosphere will be discredited with unending smears that regurgitate constantly from the left.

    Fwiw, I admit what I have written here is not neutral, but it is true as the sky is blue. I will bet a million bucks on it.

  9. Anil Wang

    Here’s the main issue I see.

    In order to be useful the rating system must be at the center, not the data. If I can rate all my work as 100% reliable in all view points, the information is useless.

    The way I see it, for it to work, raters would have to have a unique identity. Ratings agencies (which also have a unique ID) can then rate the raters on their scale and assign a number -1000 to 1000 to this person. Eycyclosphere articles would have scores based on the raters.

    Eycyclosphere curator sites would then use all this information to determine what content gets displayed in what ranking, possibly with some user configuration. Over time, a standard set of rating agencies would emerge such as MAGA, SPLC, Traditional Catholic, Orthodox Jewish, CNN, NewsMax, etc, with less known raters being mostly ignored but still present.

    Eycyclosphere curator sites can be tame (i.e. people people from many ratings agencies, but make sure their ratings are in the range -50 to 50) or controversial (i.e. people people from many ratings agencies, but make sure their ratings are less than -500 or greater than 500) or one sided (e.g. you’re researching what anti-religious people think so you pick all the below -500 ratings of every religious groups).

    It can be all things to all people.

    After this, it’s critically important that the ratings be linked to a specific article since it’s far too easy for a person to bait and switch, namely I could write an extremely glowing article from one point of view which gets 1000 ratings from that point of view and then a month later, update the article to say the exact opposite. I can then use that updated article to “prove” some very damming things about those raters.

    So the rating must be tied to unedited article via public key or a blockchain.

    1. The rating system is certainly important. My view is that it will be driven by white lists, i.e., lists of trusted raters, rather than anything that accepts just any old raters.

      And yes, absolutely right, raters need to have a unique, verifiable identity, so that there is one vote, one person (or one organization). And yes, there needs to be data, similar to LinkedIn, according to which individuals and organizations can be rated on various claims (expertise, etc.) they make.

      All of this is explored in posts linked from blog.encyclosphere.org (soon to be launched).

      1. Carla Rogers

        Trusted raters could be perfect. How does a rater become trusted? What is to stop the left from taking over who gets trusted?

        1. Maybe some apps choose which raters are trusted; but there will be free speech apps that allow users to choose for themselves. I’ll be using that kind.

  10. Jo Ann McCoy

    Thanks ? and ask Everyone to PLEASE SHARE THIS POST TO HELP TO AWARENESS

Leave a Reply

Your email address will not be published. Required fields are marked *