Authentication Hacks

My first talk was on User Authentication with MU in Existing Ecosystems, all about integrating WP with LDAP/AD/CAS and other directory authentication schemes, as well as the hacks I did to make that integration bi-directional and deliver new user features. My slides are online (.MOV / .PDF), and you can read earlier blog post summing up the project.

Plugins Mentioned

• wpCAS (long description)
• Alternate Contact Info
• WordPress Ticket Framework
• wpSMS (long description)

Scriblio

I was most excited, however, to talk about Scriblio, a plugin that turns WordPress into a library catalog with faceted searching and browsing. Those slides are online as well (.MOV / .PDF). The core plugin is in the repository, but I’d recommend people join the mail list if they’re thinking of diving in to it.

Scriblio Sites I Demoed

• Collingswood Public Library
• Colby-Sawyer College Archives
• Beyond Brown Paper photo archive

Click here to view the embedded video.

Click here to view the embedded video.

I should have done screencasts like the above long ago. It’s not that they’re great, but they are a wonderful excuse to use the canned lounge music I’ve got. Those videos are now on the front page of the official Scriblio site, and I did five more to demo the installation and configuration. Big thanks go to Collingswood NJ Public Library Director Brett Bonfield who let me use his library like this.

My slides for my presentation yesterday at code4lib are available both as a 2.7MB QuickTime and a 7.8 MB PDF, while the gist of talk went something like this:

Scriblio is an open source WordPress plugin that adds the ability to search, browse, and create structured data to the the popular blog/content management platform. And WordPress adds great ease of use, permalinks, comments/trackbacks/pingbacks, and other social and web-centric features to that structured data. But that’s not news. The news is that Scriblio now has an internal data model that supports much more sophisticated uses (slides 3 and 4). Whereas previous versions of Scriblio were mostly just display and social interaction interfaces to data that’s created or managed elsewhere, this new version supports soup to nuts creation and management of collections. Colby-Sawyer College’s archive (slide 5) is the first to implement this (take note of how the horizontal search layout makes the facets more visible and usable).

And that new data model also improves the usefulness of Scriblio to regular libraries (Collingswood (NJ) Public Library is shown on slide 6). Because Scriblio has an internal awareness of the metadata, it can automatically merge records from multiple sources (or multiple copies of the same record from the same source). The source of each piece of metadata in a record is identified and preserved (see the sourceid column in slides 7,8,9), allowing records to contain data from multiple sources (each with, perhaps, its own licensing terms). A practical example is enriching book records with data from LibraryThing’s Common Knowledge web service, making that data part of the index and facets in the local catalog, while also properly crediting the service when a record contains that data.

The automated merging of records enables a few new applications. Among them: the merging of an A to Z periodical list with the ILS’s inventory, or the creation of a union catalog from several systems. Slide 11 shows a prototype union catalog that shows materials (and their real-time availability) from three institutions in New Hampshire. Assembling that catalog was as easy as entering each ILS’s hostname and record number range in the harvester (slide 12).

I didn’t mention it during the presentation, but Scriblio is now built to work well in both regular WordPress as well as WordPress MU, the multi-user version of WordPress that allows a single installation to host many different sites (think WordPress.com) at a marginal cost to the hosting organization that approaches zero. The work to make Scriblio compatible with WordPress MU was supported in part by the National Endowment for the Humanities (there’s lots more to say about that project soon).

The above graph is far from typical, but I love that the box (the top one in this picture) can do the job when it needs to. This activity is a result of bulk record imports, web activity results in relatively little database traffic due to my use of Memcached and Batcache.

It’s not WordCamp Paris (running on 7 February), but WordCamp Edu Northeast is today. I’m there to meet up with fellow WordPressies and talk about extending WordPress with Holladay Penick and Dave Lester.

Squeezing the three of us into a single time slot requires quite a bit of cutting, especially if we hope to have time to answer questions, so I’ll be focusing on Scriblio. That means I won’t be talking about how we’re going to use BuddyPress or replace significant portions of our university portal with it. Still, my slides are available as both QuickTime and PDF files.

It’s worth mentioning wpCAS (plugin directory page) in this context. I maintain the plugin and we use it to integrate WPMU with our central authentication infrastructure.

I’ve long been a fan of WordPress, and my feelings on open source are clear, but here’s another reason to love WP: A list for the commercial portal software we now use had seven messages last week, most of them asking for help and few of them getting answers. WP-Hackers, the development list, had 179 in the same period. It’s that kind of activity that supports the development of new features and the rapid fixing of bugs (or not, in the case of the commercial product).

Slides: QuickTime or PDF.

Hi, I’m Casey. I developed Scriblio, which is really just a faceted search and browse plugin for WordPress that allows you to use it as a library catalog or digital library system (or both).

I’m not the only one to misuse WordPress that way. Viddler is a cool YouTube competitor built atop WordPress that allows you to tag and comment inside the timeline. StayPress is a property management and booking system also built atop WordPress.

BuddyPress is a social network in a box — really, take a look at the theme screenshots. Each user has a profile and friends. Users form groups and engage in discussions or private messaging. And of course, it’s WordPress afterall, users can each have one or more blogs. And then all of that is brought together in this activity updates view.

And again, because BuddyPress is just a bunch of WordPress plugins, you can use it in conjunction with Scriblio to get faceted searching and browsing of all sorts of materials, and, perhaps, use it in your community to build a community driven digital archive.

But this social network isn’t necessarily your social network and not everybody can login to my system. The solutions so far are OpenID, which makes it easy and secure to use multiple systems, and OAuth, which makes it easy and secure for users to give other applications or websites permission to use your data without having to toss their username and password around the web like confetti. And those are foundations of DiSo, the distributed social network, which leverages open formats to reduce social network fatigue (see xfn, hcard, and xoxo).

And that’s cool, because the goal of this isn’t to build a new social network, the goal is to build new applications that are socially aware (and geographically aware too).

(crossposted at Scriblio.net)

Using the newly released book viewability API in Google Book Search, Plymouth State University’s Lamson Library and Learning Commons is one of the first libraries to move beyond simply listing their books online and open them up to reading and searching via the web.

Take a look at how this works with books by Plymouth authors Bruce Heald and Joseph Monninger. The “Browse on Google” link in the New Features section leads to extended previews of their works where you can browse excerpts of the books and search the full text.

Matthew Batchelder wrote the JavaScript that makes it work, and all the features are incorporated in the current version of Scriblio. To implement it in an existing Scriblio installation, take a look at Matt’s script how it’s included in the theme’s header.php. You’ll also need to make sure your site’s catalog records include ISBNs to link with (I’ll be adding support for LCCNs and OCLCNs soon). If you’re using the standard MARC or III importers and your source records contain ISBNs, you should be all set.

Hat tip to Tim for giving me the hookup.

Take note of the “New Feature: Text this to your cellphone” line above.

Adam Brin of Tricollege Libraries explained that the “text this to me” feature he built to send location information about items in the library catalog as text messages to a user’s cell phone is being used as many as 60 times a day. That was the news I needed to decide to offer the feature in PSU’s Scriblio implementation.

The messages are handled by Clickatell via an API I added to bSuite, my do-everything plugin for WordPress (hmmm…what else can we SMS enable?).

I’m honored to be invited to the Ontario Library Association Superconference to present my work on Scriblio today (session #1329). A PDF of my slides is online.

Scriblio has had about a year of use in production at each of three sites, and the lessons suggest that Web 2.0 technologies really do work for libraries. And the best news: we can do it without breaking the budget: I’ll be demonstrating how to install Scriblio and reinvent a library in about ten minutes.

Why the slide above? Web 2.0 applications work best when they have a good logo. That’s Scriblio’s.

Update: I’ve posted the screencast I used to demo the Scriblio install and configuration process. It really needs the narration I did during the presentation and I’m planning on doing a new screencast soon, but I think this may offer some value to someone.

There can be no arguments about it, machine tags are cool and they solve problems. And now they work in WordPress with bSuite too (svn only, for the moment).

It’s not just because flickr popularized them that I like them, though it helps and you should definitely look at that stuff:

• The announcement
• Excitement from O’Reilly Radar, ProgrammableWeb, and Dan Catt (who championed the concept at flickr, I think).

Part of what I like about machine tags is that they bring some more structure (but not too much) to the folksonomic ecosystem. I’m not sure how many of the 292 named flickr mashups use machine tags, but there’s a lot of possibility in them.

For my part, I added machine tag support to bSuite because Scriblio needed it. And it was a message on the Scriblio mail list that kicked me into gear to make it work.

Scriblio 2.3 v4 is out. See it. Download it. Install it. Join the mail list.

What’s new?

• Lots of small bug fixes.
• Implemented wp_cache support.
• Revamped SQL query logic for better memory efficiency.
• New widget options.
• Search suggest/autocomplete support (implemented in the new theme).
• New theme. New Theme! By Jon Link.

It’s way cool to see Lichen’s Scriblio installation instructions translated to Hungarian. Even cooler to have Sarah the tagging librarian take hard look at it and give us some criticism (and praise!). But I’m positively ecstatic to see Robin Hastings’ post on installing Scriblio (it’s not easy on Windows, apparently).

Part of it is pride in seeing something that I’ve been working on for so long finally get out into the world, but Scriblio really does get better with every comment or criticism. And it takes giant leaps forward every time somebody installs it and reports on how it went. Way cool. Thank you.

The conference program says I’m speaking about designing an OPAC for Web 2.0, and I guess I am, but the approach this time is what have we learned so far? And though it’s the sort of thing only a fool would do, I’m also planning to demonstrate how to install Scriblio, a web 2.0 platform for libraries (foolish because I plan to do it live and in real time).

The slides for my main talk are online in Quicktime and PDF format. Extra: how the steam engine relates to all this.

Scriblio, IL2007, Internet Librarian, libraries, presentation, conference, web 2.0, native, library 2.0

A little more than two years after I realized how (really) bad the problem was and about 18 months after I prototyped my solution, our new library website, catalog, and knowledgebase launched last week — just in time for the fall semester opening.

It’s all built on Scriblio, includes a very simple new books list that you can narrow by subject and get via RSS. And if you search for subject areas like anthropology, economics, english writing, or any of a few dozen other topics, you’ll find our librarians’ subject guides listed at or near the top to help you out. You can also use the facets, clustered metadata shown in the right sidebar that reflect the aggregated results of that search†, to easily explore the collection or find the exact resource you need.

This started out simply, but the distance from prototype to working, um, product is difficult, dangerous, and frustrating. Still, when successful, it’s also wonderfully gratifying. And none of this would have happened without the help and support of a number of friends and colleagues both inside and outside the my library (callouts: Zach, Matt, Lichen, Jessamyn, Jon, Elaine, David, Anne, Dwight, Chris, PSU, The Andrew W. Mellon Foundation, and a lot of fellow library bloggers who’ve shared stories, spread the word, and helped make magic).

Thank you. Thank you. Thank you.

One more thing: This site isn’t perfect, but it’s a library catalog we can fix. Tell me what’s wrong, or better yet, download the software, join the list, and let’s work on it together so we can all have a better system.

† a set of facets can show you that anthropology is related to history, sociology, and ethnology, and help you narrow any of those subjects down to field work, methodology, or study and teaching.

library, libraries, lib20, library 2.0, Plymouth State University, Lamson Library, website, launch, Scriblio, WPopac

I was honored to be a panelist at the LITA/ALCTS CCS Authority Control in the Online Environment Interest Group presentation of “Authority Control Meets Faceted Browse.”

What is faceting? Why is it (re)emerging in use? Where can I see it in action? This program is intended to introduce the audience to facet theory, showcase implementations that use faceted approaches for online catalogs, and facilitate discussion on the relationship between structured authority data and this type of navigation.

Kathryn La Barre of University of Illinois at Urbana-Champaign explained the theory, while NCSU’s Charley Pennel, Vanderbilt’s Mary Charles Lasater, and I each described its implementation in Endeca, Primo, and Scriblio respectively. Scriblio is an open source project that has less than one FTE working on it, so it’s an honor to see it compared against commercial offerings, especially NCSU’s groundbreaking work.

My slides are online in QuickTime and PDF form, and I was proud to be able to show off the new public beta of the Lamson Library website and catalog, based on Scriblio.

I should be careful to point out that faceting is a theory of cataloging and classification, while clustering is the technical process of aggregating and reporting relevant metadata in search and browse screens. The difference is that Scriblio doesn’t impose rules on our cataloging practice, it simply supports clustering the metadata to make it easier to find the resources we’re looking for.

If anything, the importance of authority control increases in faceted/clustered search and browse systems, but it is a matter of exchanging one set of technological constraints for another. Card catalogs, with their alphabetical access and physical affordances (or limitations) demanded cataloging practice that is in some ways at odds with the very different affordances and limitations of faceted/clustered search and browse.

Among current implementations, clustering does well with subjects, but poorly with authors. Looking at the cardinality of those facets, it’s easy to understand the problem:

(statistics from the Lamson Library (beta) catalog.)

The number of unique authors compared to the number of total authors is very high, while a large number of subjects are represented by a small number of unique headings. Still, some authors are well suited to faceted browse, and their emergence in a result set could be mined to help users further refine their searches. Example: J. K. Rowling is an obvious top author in searches for both “harry potter” and “j k rowling”. Her statistical “pop” in the results might be worth looking at and worth leveraging elsewhere.

As currently implemented, however, clustered results most help the user who doesn’t know the proper terms for her field of interest. A user searching “sociology of education” is likely to be interested in materials cataloged under “educational sociology,” and clustered search navigation works well in that and similar circumstances.

clustering, faceting, faceted search and browse, authority control, library, library 2.0 lib20, libraries, Scriblio, presentation, LITA, ALCTS

Context: Below is the text of my virtual presentation to the LITA BIGWIG (it stands for blogs, wikis, interest group, and stuff) Social Software Showcase. The presentation is virtual, but the round table discussion is going on today, June 23rd, from 1:30-2:30 p.m. in the Renaissance Mayflower Cabinet Room. I won’t be there, though. My bad scheduling got me double-booked and I’m presenting in the Transforming Your Library With Technology track.

— – —

We’re swimming in reports that tell us to reduce expenses while the costs of our systems continue to rise. Compare this to the trend outside libraries where commoditization of bandwidth, storage, and even servers as well as the maturing of our software and management practices has made possible large numbers of competing, free services in almost every category (among the most recognizable we find Gmail, YouTube, and flickr). And those who want more direct control over the network services they use can find open source software to match those offerings and service providers to help them use it.

Libraries are good at sharing data, but we’ve done a poor job of taking advantage of the network and new technologies to reduce the costs of sharing or build network-dependent features. One result is that it’s often cheaper to buy a book than to do an ILL transaction. The success of Linux, Apache, and every other open-source application has been the success of network-enabled efficiencies that allowed aggregation of improvements from a broad range of contributors.

In libraries, this applies equally well to both our systems and data. We recognize now that our data is living and evolving, but synchronizing available record enhancements with individual collections remains costly and laborious. Without efficient mechanisms to share improvements, the value to any one library of trying to share what local improvements or corrections they make is limited, preventing libraries from benefiting from the network in ways that open source software development has.

Extending some of the affordances of open source further, remixing and mashups have shown the power of open systems and common, easy to use protocols. Those mashups are pointing the way to new applications and features that the platform providers themselves often can’t foresee or afford to develop on their own. Libraries, struggling as we are with developing the features our users are demanding, need remixable platforms to support more rapid and sustainable development.

And we need platforms that are affordable to all libraries, including the nearly 30% that serve populations of 2,500 on an average annual budget of less than $50,000 (about 60% of America’s libraries serve communities of fewer than 10,000 people).

That’s some of the philosophy driving this IMLS grant proposal. The key features of what I hope to achieve are simple: We’ll need a lot of applications to do this, and all of them will share these characteristics:

• Open source and free in both the “free beer” and “free speech” senses of the term
• Remixable and open for others to innovate with
• Social

From there it’s really a matter of what we hope to achieve…what we build.

scriblio, internet archive, imls, bigwigshowcase07, open source, community informatics, presentation

The problem with working on Scriblio is that I end up running into so many interesting looking books. Just this morning I discovered a number of recent acquisitions in the 19th Century and 20th Century subject feeds in my development instance (also available via RSS).

All of this is under active development, so those links may or may not work, and the site is definitely changing URLs soon. Still, I had to bookmark these books somehow so I could come back to them.

books, scriblio, joy of discovery