User:Elper/sandbox

Curlie

Cheerful red squirrel logo on a white background
File:Curlie Directory.png
Type of site	Web directory
Available in	90 languages, including English
Parent	Curlie Project Inc.
URL	curlie.org
Commercial	No
Registration	Optional
Users	91,962
Launched	August 25, 2018 (2018-08-25)
Current status	Open
Content license	Creative Commons Attribution 3.0 Unported, Open Directory License

Curlie is a multilingual open-content directory of World Wide Web links. The site and community who maintained it were formerly known as the Open Directory Project (ODP) and lastly as (DMOZ). It is constructed and maintained by a community of volunteer editors.

Curlie uses a hierarchical ontology scheme for organizing site listings. Listings on a similar topic are grouped into categories which then include smaller categories.

From DMOZ's closure on March 17, 2017 there was significant downtime needed for the volunteers to adapt the software to a new environment until the official launch on the 25th of August 2018. As of November 2018Only the directory's RDF data output still needs to be activated.

History

For the full history of the directory from 1998 to 2017, please see DMOZ.

Several of the top-level categories have unique characteristics. The Adult category is not present on the directory homepage but it will be fully available in the RDF dump that Curlie will provide. While the bulk of the directory is categorized primarily by topic, the Regional category is categorized primarily by region. This has led many to view Curlie as two parallel directories: Regional and Topical.

Kids and Teens

A special directory within Curlie was created for people under 18 years of age. Key factors distinguishing this "Kids and Teens" area from the main directory are:

• stricter guidelines which limit the listing of sites to those which are targeted or "appropriate" for people under 18 years of age;
• category names as well as site descriptions use vocabulary which is "age appropriate";
• age tags on each listing distinguish content appropriate for kids (age 12 and under), teens (13 to 15 years old) and mature teens (16 to 18 years old);
• Kids and Teens content is available as a separate RDF dump;
• editing permissions are such that the community is parallel to that of Curlie.

As of November 2018, this portion of Curlie included over 29,000 site listings.

Maintenance

Directory listings are maintained by editors. While some editors focus on the addition of new listings, others focus on maintaining the existing listings and some do both. This includes tasks such as the editing of individual listings to correct spelling and/or grammatical errors, as well as monitoring the status of linked sites. Still others go through site suggestions to remove spam and duplicates.

QC is a Web crawler written to check the status of all sites listed in Curlie. Periodically, it will flag sites which appear to have moved or disappeared and editors follow up to check the sites and take action. This process is critical for the directory in striving to achieve one of its founding goals: to reduce the link rot in web directories. Shortly after each run, the sites marked with errors are automatically moved to the unreviewed pool where editors may investigate them when time permits.

Due to the popularity of the directory and its supposed impact on search engine rankings (See PageRank), domains with lapsed registration that are listed in the directory have attracted domain hijacking, an issue that has been addressed by regularly removing expired domains from the directory.

License and requirements

DMOZ data was previously made available under the terms of the Open Directory License, which required a specific DMOZ attribution table on every Web page that uses the data.

The Open Directory License also included a requirement that users of the data continually check DMOZ site for updates and discontinue use and distribution of the data or works derived from the data once an update occurs. This restriction prompted the Free Software Foundation to refer to the Open Directory License as a non-free documentation license, citing the right to redistribute a given version not being permanent and the requirement to check for changes to the license.

In 2011, DMOZ silently changed its license to a Creative Commons Attribution license, which is a free license (and GPL compatible).

RDF dumps

DMOZ data is made available through an RDF-like dump that is published on a download server, older versions are also archived there. New versions are usually generated weekly. An DMOZ editor has catalogued a number of bugs that are encountered in the DMOZ RDF dump, most importantly that the file format isn't RDF. So while today the so-called RDF dump is valid XML, it is not valid RDF and as such, software to process the DMOZ RDF dump needs to be specifically written for DMOZ data.

Content users

DMOZ data powers the core directory services for many of the Web's largest search engines and portals, including Netscape Search, AOL Search, and Alexa. Google Directory used DMOZ information, until being shuttered in July 2011.

Other uses are also made of DMOZ data. For example, in the spring of 2004 Overture announced a search service for third parties combining Yahoo! Directory search results with DMOZ titles, descriptions and category metadata. The search engine Gigablast announced on May 12, 2005 its searchable copy of DMOZ. The technology permits search of websites listed in specific categories, "in effect, instantly creating over 500,000 vertical search engines".

As of 8 September 2006, DMOZ listed 313 English-language Web sites that use DMOZ data as well as 238 sites in other languages. However, these figures do not reflect the full picture of use, as those sites that use DMOZ data without following the terms of the DMOZ license are not listed.

Policies and procedures

DMOZ was co-founded by Rich Skrenta (depicted in 2009, age 42).

Restrictions are imposed on who can become an DMOZ editor. The primary gatekeeping mechanism is an editor application process wherein editor candidates demonstrate their editing abilities, disclose affiliations that might pose a conflict of interest, and otherwise give a sense of how the applicant would likely mesh with the DMOZ culture and mission. A majority of applications are rejected but reapplying is allowed and sometimes encouraged. The same standards apply to editors of all categories and subcategories.

DMOZ's editing model is a hierarchical one. Upon becoming editors, individuals will generally have editing permissions in only a small category. Once they have demonstrated basic editing skills in compliance with the Editing Guidelines, they are welcome to apply for additional editing privileges in either a broader category or else another category in the directory. Mentorship relationships between editors are encouraged, and internal forums provide a vehicle for new editors to ask questions.

DMOZ has its own internal forums, the contents of which are intended only for editors to communicate with each other primarily about editing topics. Access to the forums requires an editor account and editors are expected to keep the contents of these forums private.

Over time, senior editors can be granted additional privileges which reflect their editing experience and leadership within the editing community. The most straightforward are editall privileges, which allow an editor to access all categories in the directory. Meta privileges additionally allow editors to perform tasks such as reviewing editor applications, setting category features, and handling external and internal abuse reports. Cateditall privileges are similar to editall, but only for a single directory category. Similarly, catmod privileges are similar to meta, but only for a single directory category. Catmv privileges allow editors to make changes to directory ontology by moving or renaming categories. All of these privileges are granted by admins and staff, usually after discussion with meta editors.

In August 2004, a new level of privileges called admin was introduced. Administrator status was granted to a number of long serving metas by staff. Administrators have the ability to grant editall+ privileges to other editors and to approve new directory-wide policies, powers which had previously only been available to root (staff) editors.

All DMOZ editors are expected to abide by DMOZ's Editing Guidelines. These guidelines describe editing basics: which types of sites may be listed and which may not; how site listings should be titled and described in a loosely consistent manner; conventions for the naming and building of categories; conflict of interest limitations on the editing of sites which the editor may own or otherwise be affiliated with; and a code of conduct within the community. Editors who are found to have violated these guidelines may be contacted by staff or senior editors, have their editing permissions cut back, or lose their editing privileges entirely. DMOZ Guidelines are periodically revised after discussion in editor forums.

Ownership and management

Underlying some controversy surrounding DMOZ is its ownership and management. Some of the original GnuHoo volunteers felt that they had been deceived into joining a commercial enterprise. To varying degrees, those complaints have continued up until the present.

At DMOZ's inception, there was little thought given to the idea of how DMOZ should be managed and there were no official forums, guidelines or FAQs. In essence, DMOZ began as a free for all.

As time went on, the ODP Editor Forums became the de facto DMOZ parliament and when one of DMOZ's staff members would post an opinion in the forums, it would be considered an official ruling. Even so, DMOZ staff began to give trusted senior editors additional editing privileges, including the ability to approve new editor applications, which eventually led to a stratified hierarchy of duties and privileges among DMOZ editors, with DMOZ's paid staff having the final say regarding DMOZ's policies and procedures.

Robert Keating, a principal of Touchstone Consulting Group in Washington, D.C. since 2006, has worked as AOL's Program Manager for DMOZ since 2004. He started working for AOL in 1999 as Senior Editor for AOL Search, then as Managing Editor, AOL Search, DMOZ, and then as Media Ecosystem Manager, AOL Product Marketing.

Editor removal procedures

DMOZ's editor removal procedures are overseen by DMOZ's staff and meta editors. According to DMOZ's official editorial guidelines, editors are removed for abusive editing practices or uncivil behaviour. Discussions that may result in disciplinary action against volunteer editors take place in a private forum which can only be accessed by DMOZ's staff and meta editors. Volunteer editors who are being discussed are not given notice that such proceedings are taking place. Some people find this arrangement distasteful, wanting instead a discussion modeled more like a trial held in the U.S. judicial system.

In the article "Editor Removal Explained", DMOZ meta editor Arlarson states that "a great deal of confusion about the removal of editors from DMOZ results from false or misleading statements by former editors".

The DMOZ's confidentiality guidelines prohibit any current DMOZ editors in a position to know anything from discussing the reasons for specific editor removals. However, a generic list of reasons is for example given in the guidelines. In the past, this has led to removed DMOZ editors wondering why they cannot login at DMOZ to perform their editing work.

Blacklisting allegations

Senior Curlie editors have the ability to attach "warning" or "do not list" notes to individual domains but no editor has the unilateral ability to block certain sites from being listed. Sites with these notes might still be listed and at times notes are removed after some discussion.

Hierarchical structure

Many believe hierarchical directories are too complicated. With the emergence of Web 2.0, folksonomies began to appear, and some editors proposed that folksonomies, networks and directed graphs are more "natural" and easier to manage than hierarchies.

Software

The Curlie database/editing software is closed source (although work is ongoing to make it Open Source).

Search

The ODPSearch feature is based on

Editor forums

The Curlie Editor Forums are a modified version of phpBB.

Bug tracking

The bug tracking software used by Curlie is Github.

See also

• List of web directories

External links

• Elper/sandbox at Curlie
• dmoztools.net DMOZ static mirror
• Curlie (The new home of the editable directory)
• The Resource Zone – Curlie Directory Public Forum

This page will be placed in the following categories if it is moved to the article namespace.

Categories:

• DMOZ
• 2018 establishments in the United States
• Collaboration
• Internet properties established in 1998
• Open content projects
• Web directories
• Multilingual websites