In a recent Facebook post, Walter Lewis, the primary developer at OurDigitalWorld, talked about his recent home digitization activities. A maritime historian, Walter dedicates a substantial amount of time to writing and publishing articles and books on Great Lakes ships and shipping history, digitizing and making marine history available to everyone on his VITA Digital Toolkit site Maritime History of the Great Lakes.

Walter’s expertise also reflects the principles and best practices of the ODW all-in-one digitization process, including using best copies to obtain higher Optical Character Recognition (OCR) results to enhance the user experience, and to optimize public access and discovery. In his post, Walter says, “I had the opportunity this week to ‘finish’ (to the extent that any of these projects are really finished) putting online just over 20,000 pages of the Marine Review from between December 1891 and January 1908. Up to the end of 1899, these were in bound volumes which had had the covers and some of the advertising pages trimmed off…. From 1900 to 1908, I worked from individual issues, most of which were complete with their covers, but never a complete set of issues for the years. For 1900-1902, these are supplemented by the digitized microfilm issues that were already in place… Searching is dramatically better because the OCR was significantly improved, especially of the editorial columns. Further good news is that reproduction of the images is far better (remembering the process of reproduction in those years and the effects of time on paper), with three or four levels of zoom. … I would be delighted to fill in the gaps from originals in other collections, which is why these projects are never *really* done.”

Walter’s historical research and the resulting digital collection provides well over a hundred thousand rare and wide ranging resources to the marine history community. The Maritime History of the Great Lakes site also acts as a prototype and testing ground for his development work on the VITA Toolkit. Having a public, ever developing collection is the ultimate test for the features and functionality we then share with our VITA clients. As Walter likes to say: “We eat our own dog food.” The resulting collection is a showcase not only for the VITA Toolkit but a testament to Walter’s commitment to making primary materials available online and to the never ending pursuit of a better quality, more comprehensive, and accessible historical record.

Almost immediately following the Facebook post, a fellow historian responded to Walter’s request and offered up a set of bound volumes of the Marine Review to help fill the gaps in the online collection. “OK, so I’m not finished,” quipped Walter.

Hello! This is Adam Ianson. I’m a recent graduate of the University of Toronto’s iSchool and practicum student with OurDigitalWorld during which I was involved in providing recommendations for the implementation of standardized Rights Statements as part of VITA Digital Toolkit for their partner GLAM organizations’ collections.

Rights Statements are similar to Creative Commons licenses with one important difference. They are similar in that their purpose is to communicate clearly to users what they are permitted to do with the images, articles, and other digital content they find online. They are also both international standards that support the aims of the free-culture movement by enhancing the discoverability of public domain and free-license content online and by facilitating the reuse of those materials to generate new creative works.

The important difference to note is that Creative Commons licenses are legally binding and can only be applied to content by the rightsholder (or rightsholders) of that content. Rights Statements are often better suited to the needs of cultural heritage repositories such as ODW’s partners, which in most cases do not hold the rights to the content they make available online. 

Currently, ODW partners are prompted to select one of five rights statuses to display with each item they make available on their VITA collection: public domain, copyrighted, licensed, contractual, or unknown. Each status has a corresponding statement that appears as the public description. These statements are at least consistent, but when it comes to answering the question “can I use this item?” they can only inform the user that either there are ‘no restrictions on use’ or that the user must ‘ask for permission’ with little nuance in between. Also, users are not able to search for items in the collection according to their copyright status. Rights Statements offer improvements in both of these areas.

To implement Rights Statements in VITA requires bridging the current copyright statement options to their more expressive equivalent (or equivalents) in the Rights Statements system. To better understand this task I found guidance in the British Columbia Electronic Library Network’s Arca and Bibliothèque et Archives nationales du Québec (BAnQ), two Canadian cultural heritage repositories that have implemented Rights Statements in their collections. I also consulted a draft of the research paper produced by the National Heritage Digitization Strategy (NHDS) on the use of Rights Statements in the Canadian context. 

Based on my research, I determined that two of the twelve Rights Statements have low utility for ODW’s purposes. First, the In Copyright – EU Orphan Work statement, because it references legislation that applies exclusively to member states of the European Union. The other, No Copyright – Other Legal Restrictions statement, has limitations as well. This is used to restrict free use of the item because it has designated cultural expression protections; as well, applying the statement is inconclusive without further links to legal restrictions as supplied by the steward organization. Instead, the recommendation is to employ a more granular, descriptive standard that is sensitive to the community-specific protocols surrounding the access and use of these items, such as the Traditional Knowledge (TK) Labels system developed by Local Contexts, or the proposed Open Licensing Scheme for Traditional Knowledge jointly developed by Carleton University and the Canadian Internet Policy and Public Interest Clinic.

Furthermore, I learned that the current suite of Rights Statements may not be specific enough to the Canadian legal context. For example, works published by the Government of Canada or any of the provincial offices of the Queen’s Printer are protected by Crown copyright. The use restrictions on these works are comparable to, but by no means fully encapsulated by, the existing In Copyright – Non-commercial Use Permitted statement. Therefore, it may be desirable to create a “tailor-made” In Copyright – Crown Work Rights Statement for use in the Canadian GLAM context. Or it may make sense to instead advocate, alongside the Canadian Federation of Library Associations (CFLA) and Canadian Association of Research Libraries (CARL), to retroactively assign a Creative Commons CC-BY license to publicly available Canadian government publications.

In the course of my practicum I’ve certainly come to recognize the sheer number of decisions that need to be made in the process of implementing Rights Statements in online cultural heritage collections. I also appreciate the importance of consulting extensively with partner organizations, users, and the GLAM community at large before rolling out changes to a collection numbering in the millions of items!

Interested in hearing more? I’ll be presenting next week at the the Creative Commons Summiton Tuesday, October 20, 2020.

Since 2017, ODW has been exploring low-cost options for digitizing newspapers from microfilm. Inspired by DIY and makerspace memes popular in the library community,

ODW has worked on a prototype that can be assembled from readily-available components with a view towards providing a low-cost alternative for microfilm scanning. The approach centers around macrophotography, a technique that employs a special lens to zoom in at a level that allows intricate details of an object to be captured. Macrophotography has typically been used for capturing details of subjects in nature, like insects and flower petals, but it has broad application for anything at a reduced scale, including tiny photographs of newspaper pages.

At the 2018 OLA SuperConference, ODW Board Member and University of Windsor librarian, Art Rhyno, presented an overview of the first version of the prototype in a session entitled DIY Digitization of Community Newspapers. Part of the presentation included a video of the prototype (see below).

It is admittedly difficult to discern the components of the prototype in the video, but it illustrates 3 of the 4 building blocks to microfilm scanning listed in the 2018 presentation:

1. Dealing with torque
2. Configuring a stable camera arrangement
3. Supplying appropriate lighting
4. Finding flexible options for merging

Torque is a “twisting force to cause rotation”, and is needed to rotate microfilm reels in order for a camera to take pictures at different parts of the reel. Microfilm is surprisingly challenging for motors, and requires a fairly high level of torque to stand up to rotating reels for hours at a time. The best results were achieved with a rotisserie motor rated for 50 lbs, and one surprise with this setup was discovering that very few models of this type of motor had consistent turning directions, i.e., most randomly spin clockwise or counter-clockwise but not necessarily the same way twice.

The camera arrangement can be achieved with a tripod and possibly some creativity if the positioning of the camera over the light source is awkward (as you might guess from the video). A light table or a LED work light with a sheet of white plexiglass can provide the light source for illuminating the film. The results can be seen below, using an advertisement from the Nov. 20, 1874 edition of the Amherstburg Echo, there is no doubt that using a camera with a macro lens can be an effective strategy for capturing the level of detail necessary for microfilm.

An original microfilm scan [Figure 1] from a decade ago. The film’s imperfections and the challenges of the illustration itself combine to make a problematic image.

A recent scan [Figure 2] from a commercial provider. This scan has been post-processed to increase the contrast between the ink and the background page. This is certainly an improvement over the first image but is still difficult to read.

The same page [Figure 3] with macrophotography. The image is much truer to its original form, though still challenging (for example, the lines in italic).

The original prototype used a standard DSLR Camera but the moving mirror in a DSLR eventually became problematic for microfilm since so many pictures were required to capture an entire reel and the parts would soon wear out. A mirrorless camera turned out to be a better option. Without moving parts, a mirrorless camera can take many more photos, an important consideration when a single reel can represent more than 1000 pages. The other key piece of camera equipment is a macro lens. Some microfilm may not require the level of magnification that a macro lens provides, but newspaper pages, in particular, need much stronger zoom support than a standard lens typically provides.

ODW, in partnership with the University of Windsor, has now scanned hundreds of newspaper reels. At the time of this writing, newspaper reels continue to be scanned, as can be seen below:

Note that this arrangement has two scanners controlled by one workstation. From the beginning, Ubuntu has been the backbone of the system controlling the scanning, relying on the remarkable ecosystem that linux has fostered. Many pages can be split into two or more images, depending on the way the page was photographed for the microfilm, and there has been no shortage of high quality image merging software to “stitch” the pages back together.

There have been some hard lessons to be learned along the way, however. Unlike the majority of computer equipment, camera equipment tends to fluctuate more wildly in pricing. The mirrorless camera purchased last year for $600 CAD, is now nearly 3 times that cost! At the same time, there is a newer mirrorless model that is about $400 CAD. It can be good to have a conversation with someone versed in camera equipment before assembling a scanning station.

The majority of historical newspapers will benefit from macrophotography, but some microfilm, particularly vesicular microfilm, will not benefit from the lighting system and may appear “washed out.” Badly scratched and/or dirty microfilm may, in turn, produce high resolution images of flaws in the film in addition to the pages themselves.

Perhaps the most difficult challenge of all is to try out alternative approaches. It is not easy to walk into a camera store with microfilm and a light source in order to sample different cameras and lenses. Phone cameras, which are improving at an incredibly rapid pace, are even more problematic for testing, since they tend to be tied to phone plans and reseller arrangements. In all these cases, there is usually a need to purchase equipment up front, and hope that it provides the desired results upon deployment.

ODW is currently investigating options for microfiche scanning. Most newspaper projects avoid microfiche formats but sometimes there is no other alternative, particularly with small community newspapers in Ontario. We welcome partners in exploring scanning options for these formats and would like to achieve a blueprint that would put low-cost scanners into the reach of almost any organization seeking to convert film formats to digital form.

OurDigitalWorld is very pleased to have been involved in this project, working with the Federated Women’s Institutes of Ontario for more the past 4 years, processing the materials for full text search and hosting the materials for search and discovery via the VITA Digital Toolkit.

From a Press release from Irene Robillard, Federation of Women’s Institutes of Ontario:

The Federated Women’s Institutes of Ontario completed its three-year project through the Documentary Heritage Communities Program of Library and Archives Canada on March 31^st, 2020. During this time 225,000 pages have been digitized and added to our Virtual Archives, most being our Tweedsmuir Community History Collections.  These collections, with many starting in 1947, contain the history of a local community and can include farm and family histories, biographies, and photos.  

Books from as far north as Cochrane in the northeast and Kenora in the northwest, down to beyond London in southwestern Ontario, the Ottawa Valley in the east, and many books in between were brought to a central digitizing site and then returned.  Some books were found that we were not aware of, and one book was saved from destruction.

We have fostered positive relationships with archives, museums, libraries, and historical societies throughout Ontario, with a few using our Virtual Archives to put their previously-digitized Women’s Institutes (WI) documents online. As well, some WI branches and districts have self-funded digitizing.

About half of the documents have not yet been opened to the public, as they need to be reviewed for privacy concerns. This will happen over the next year or two. As well, there are many more books to be digitized [with] a waiting list for digitizing from branches, districts, and holding organizations.

The public can freely access the Virtual Archives at http://collections.fwio.on.ca/search. As well, the FWIO records as well as Women’s Institutes records from other organizations can be found through the WI portal: http://portal.fwio.on.ca.

If you have a suggestion of other resources to be added to the collection, please contact the FWIO or OurDigitalWorld at info@ourdigitalworld.org.