Posts Tagged ‘LIDP’

EMALINK seminar on activity data and the LIDP

Posted on June 15th, 2012 by Paul Stainthorp

The details of a workshop I’m speaking at in July; relates to the University of Huddersfield-led Library Impact Data Project (LIDP), in which Lincoln and DMU participated last year.

EMALINK Seminar

Library Data Impact Project

De Montfort University
Kimberlin Library
Lecture Theatre, 00.11
Tuesday 17th July 2012
2.00 – 4.00 pm
(Light refreshments available from 1.45pm)

The JISC Library Data Impact Project proved a statistically significant correlation between library usage and student attainment. Two universities in the region, De Montfort and Lincoln, participated in the project and will present on their approaches to the collection of library activity data and the analysis and dissemination of the results. There will also be an opportunity for participants to discuss the practicalities and value of gathering and using such data, within our libraries and the wider institution.

Session leaders:
Phil Adams, Senior Assistant Librarian, De Montfort University

Marie Letzgus, Senior Assistant Librarian, De Montfort University

Paul Stainthorp, Electronic Resources Librarian, University of Lincoln

Contact your EMALINK representative to book a place by Wednesday 11th July. There are three places available per institution.

The DMU campus is a 15-20 minute walk from Leicester train station. Limited visitor parking is available on campus – please advise your EMALINK rep on booking if you wish to request a parking space. Campus maps available from: www.dmu.ac.uk/about-dmu/how-to-find-us.aspx

The data! The data!

Posted on October 3rd, 2011 by Paul Stainthorp

The Library Impact Data Project (LIDP), which ran from February-July this year, and in which the University of Lincoln took part, has now released a subset of the library activity data used in the analysis (which, you’ll remember, showed a statistically significant correlation across a number of universities between library activity data and student attainment).

Lincoln’s data is included in the release, which is available for re-use under an open licence, from:

http://eprints.hud.ac.uk/11543/

This data set is made available under the Open Data Commons Attribution License
http://opendatacommons.org/licenses/by/1.0/

The data contains final grade and library usage figures for 33,074 students studying undergraduate degrees at UK universities. More information on the data, and how it’s been generalised in order to preserve students’ anonymity, on the LIDP project blog.

  • There’s also a detailed report about the statistical breakdown of Lincoln’s own share of the data (this wasn’t published as part of the project reports, as it was down to each individual institution whether to make it public or not) – I’ve made the report available here [PDF].

The LIDP blog also contains information about the project ‘toolkit‘, developed to assist other institutions who may want to test their own data against the LIDP’s hypothesis, here and here.

Thanks again to Graham, Bryony and Dave at the University of Huddersfield for inviting Lincoln to take part in the project, and for their help along the way!

On to the next one…

Activity data workshop, Leeds, 5th September

Posted on September 13th, 2011 by Paul Stainthorp

Last week Elif and I attended a half-day workshop at the University of Leeds, entitled ‘Improving processes by using activity data‘, which was organised as part of the JISC Activity Data ‘Synthesis’ programme, as a pre-conference event before the 2011 ALT-C conference.

I got the impression that only about half the expected delegates turned up, which seems a bit poor form, but perhaps all too common for a free workshop.

Presentations from:

One thing (of many useful things) that came up in the discussions surrounding these presentations was around the “usefulness” (utility?) of activity data, and how that usefulness is ‘sold’ to the parent institution: shades of business case-type arguments around recruitment, retention, impact, resource management, etc., but what about the user experience? What about the service quality (sez Ben Scoble of Staffordshire University)?

There’s a danger that these aspects could be missed in the drive to produce a convincing ‘traditional’ business case for activity data, when they are the things we ought to be concentrating on the most (and I tend to assume that, as long as I still have a job, the overall case for providing a quality library service has already been accepted by my institution… at least for the time being).

Then on to activities (ha ha), and a group discussion around the way forward in making it easier for libraries to gather and use activity data. Placed on the spot by David Kay (a consequence of “Lincoln having done all of this sort of stuff already“!! – i.e. participated in the MOSAIC and LIDP projects), I reiterated my point that we should really only be concerned with trying to build a better service for the library. We shouldn’t have to constantly refer up to—e.g.—the effect on student satisfaction, retention, or attainment. Take them (for practical purposes, anyway) as a given. The case has already been made, and as long as your library is open for business, your institutions wants you to use activity data. They do. They really do.

All that remains now is for all of us (esp. the Synthesis project) to come up with a sane, usable, ultra-lightweight event-based (WWWWWH) data-exchange format which would allow institutions to easily share and re-use activity data: practival interoperability for libraries and l-users across all library domains. There are some good ideas floating around (they pretty much scream Linked Data), and I’m sure you’ll be hearing about them soon.

The JISC Activity Data Synthesis project blog is at: http://blog.activitydata.org/

LIDP: end of project. Using libraries = good.

Posted on July 28th, 2011 by Paul Stainthorp

I was in Huddersfield last week for the final project meeting of the Library Impact Data Project (LIDP).

LIDP was successful in proving that:

There is statistically significant relationship between both book loans and e-resources use and student attainment. And this is true across all of the universities in the study that provided data in these areas.

“We want to stress here again that we realise THIS IS NOT A CAUSAL RELATIONSHIP!  Other factors make a difference to student achievement, and there are always exceptions to the rule, but we have been able to link use of library resources to academic achievement.”

An initial (outline) report on how the University of Lincoln’s own activity-attainment holds up to this same statistical inspection is available to download from here [PDF]. As much as possible of the library activity data used in the project will be released under an Open Data Commons Attribution License in the near future, and hosted on the project blog.

LIDP [old photo]Thanks are due to Graham Stone, Dave Pattern, Bryony Ramsden, and all the project partners for the opportunity for Lincoln to participate in this project. We had fun getting our together. The end-of-project blog post for LIDP is here – it suggests some very interesting areas for further investigation.

Personally, I’m very interested in looking for cross-institutional comparisons – perhaps trying to explain particular levels of activity-attainment attached to individual subject areas, irrespective of which university the student is at (i.e. does a Lincoln computing student have more in common with a Lincoln business student, or with a Huddersfield computing student?). I’d also be interested in looking particularly at those students whose library activity behaviour changes through the life of their course, and who then go on to get a better degree than they might have been predicted based on their library activity in their first year.

“Finally, we have been astonished by how much interest there has been in our project. To date we have two articles ready for publication imminently and have another 2 in the pipeline. In addition by the end of October we will have delivered 11 conference papers on the project. All articles and conference presentations are accessibly at: http://library.hud.ac.uk/blogs/projects/lidp/articles-and-conference-papers/

I can see this project getting cited, and cited again, simply every time anyone wants to argue that academic libraries are A Good Thing.

What I been up to

Posted on July 7th, 2011 by Paul Stainthorp

Apologies: this is one of those generic catch-all blog posts. I attended four separate events last week: here’s a short report from each one.

~~~

Kimberlin1. CILIP UC&R Members’ Day: Making an Impact

De Montfort University, Leicester. 28 June, 2011

This workshop for CILIP members was looking at various ways in which libraries can have (and can measure) their ‘impact’. I spoke first about Lincoln’s involvement in the University of Huddersfield’s Library Impact Data Project (LIDP), and how that project is trying (successfully, it seems) to measure the relationship between students’ library use and their degree ‘success’.

Then DMU subject librarian Jason Eyre talked about his PITSTOP project, which built a mediated forum for online discussion between Social Work students on placement, their lecturers, and their practice educators (in the NHS and local authorities). Jason explained that while the online discussion forum itself was not very well used, the impact of the project was that is acted as a catalyst for building a better relationship between students, academics, practice educators, and the library.

After a very well-run World Café session, where we moved around between different tables, each themed with a different aspect of ‘impact’ in libraries – and then lunch, information management consultant David Streatfield presented on the difficulties of measuring and evaluating the impact that academic libraries can have. He outlined some of the different approaches that have been taken in the past, and how those approaches can be less than successful in an environment of government pressure to control public service provision.

Lastly, Maria Cotera, former president of the CILIP Career Development Group, told us several anecdotes about the ways she has seen library workers make an impact themselves, through their involvement in staff development, social, and extra-professional activities. In an exercise, all the delegates came up with an example of a shared pressure or circumstance in our home institutions that could be turned into an opportunity for staff development.

Thanks to Marie Nicholson and the UC&R East Midlands committee for inviting me to speak! Twitter hashtag: #UCREMimpact.

~~~

Great Central Icehouse2. EMALINK event on collection development

University of Lincoln. 29 June, 2011

This was another East Midlands event, and the first EMALINK event held in Lincoln since we joined that network. It was organised, jointly, by the University of Lincoln, our neighbours Bishop Grosseteste University College, and Nottingham Trent University (NTU). The theme was the lifecycle of collection management: from selection and acquisition, through analysis and review of collections, and finally disposal.

NTU kicked off with a look at their work to incorporate Talis Aspire into the DNA of their library: they’re building a set of resource selection and allocation processes that are strongly driven by the resource lists built by academics using Aspire. Lincoln responded with two short presentations about collection analysis: our project to compare the strengths and weaknesses (in size, breadth, and age) of the various subject collections in our physical bookstock with the relative sizes of the student body in different subject areas; and our work to determine value for money in ‘Big Deal’ database subscriptions. Finally, Susan Rodda from Bishop Grosseteste talked about the options for disposing of unwanted physical library stock, and how BG have managed, for several years, to weed their collection without sending any paper to landfill.

~~~

Goodenough library (detail)3. JISC Managing Research Data Programme (#jiscmrd) community briefing event

Goodenough College, London. 1 July, 2011

On Friday, I attended this briefing event for the current JISC research data funding call for proposals, on Joss Winn‘s behalf. The JISC programme manager ran through the requirements and expectations for the various strands of this current call. Kevin Ashley of the Digital Curation Centre also presented: about how the DCC can support and work with institutions who are running research data management projects. See hashtag: #jiscmrd for information about the programme.

~~~

OU Library4. JISC Innovations in Activity Data workshop

The Open University, Milton Keynes. 4 July, 2011

After a long, Sunday-afternoon train journey to Milton Keynes, I paid my first ever visit to the OU’s Walton Hall campus for another activity data-related event, this time organised and hosted by the team behind the JISC-funded RISE (“Recommendations Improve the Search Experience”) project.

The day began with three presentations from projects funded under the current JISC activity data strand:

  1. Joy Palmer of MIMAS and the SALT project (“Surfacing the Academic Long Tail”: MIMAS working with the John Rylands University Library of the University of Manchester);
  2. RISE themselves (Richard Nurse of the OU) talking about how they are using EZProxy log data to power a recommendation service (“…users who looked at this, also looked at these…“);
  3. Via video link, live from Huddersfield: Dave Pattern talking about LIDP.

Then, another World Café-type exercise (two in one week!). We moved about the room, scribbling on the tablecloths, making notes about: [a] what activity data universities have at their disposal; [b] what use we might put it to; and [c] what barriers are in our way.

In the afternoon: two more presentations. The OU’s Tony Hirst (a.k.a. @psychemedia), rattling and rambling through various techniques for visualising activity data. This is really valuable stuff… what I’m less clear about is: where’s the first rung of the dataviz ladder? How does a muggle start thinking about data visualisation? Tony says that many of the techniques he writes about are things he “didn’t know how to do a couple of hours before…“, but that doesn’t necessarily mean that the rest of us will find them as easy to pick up! Tony’s coming to Lincoln soon, so I’m going to try and talk to him about data visualisation a bit more then.

Last of all, David Kay (of SERO and the JISC activity data Synthesis Project: kind of an umbrella for all of these separate activity data initiatives) summed things up nicely: including an excellent slide listing the kinds of skills library workers are going to have to develop in order to do justice to activity data: including data visualisation, again! I’ll post that slide here, if and when I can find it.

There was a little bit of activity on Twitter for this workshop: look for the hashtag #iad11.

~~~

I’ll be making an impact in Leicester tomorrow

Posted on June 27th, 2011 by Paul Stainthorp

I’m at De Montfort University in Leicester tomorrow, giving a presentation at the CILIP UC&R East Midlands members’ event: Making an Impact. My presentation is about our involvement in the JISC-funded Library Impact Data Project (LIDP) with the University of Huddersfield. My slides are online.

If you want to skip the monkey and head straight for the organ-grinders, my presentation borrows fairly heavily from two documents produced by the LIDP project team at Huddersfield:

Library Impact Data Project: good news, everybody!

Posted on June 18th, 2011 by Paul Stainthorp

I think this is worth re-posting from the LIDP blog:

LIDP graphicWe are very pleased to report that we have now received all of the data from our partner organisations and have processed all but two already!

Early results are looking positive and our next step is to report back with a brief analysis to each institution. We are planning to give them our data and a general set of data so that they can compare and contrast. There have been some issues with the data, some of which has been described in previous blogs, however, we are confident we have enough to prove the hypothesis one way or another!

In our final project meeting in July we hope to make a decision on what form the data will take when released under an Open Data Commons Licence. If all the partners agree, we will release the data individually; otherwise we will release the general set for other to analyse further.

I submitted Lincoln’s data on 13 June. It consists of fully anonymised entries for 4,268 students who graduated from the University of Lincoln with a named award, at all levels of study, at the end of the academic year 2009/10 – along with a selection of their library activity over three* years (2007/08, 2008/09, 2009/10).

The library activity data represents:

  1. The number of library items (book loans etc.) issued to each student in each of the three years; taken from the circ_tran (“circulation transactions”, presumably) table within our SirsiDynix Horizon Library Management System (LMS). We also needed a copy of Horizon’s borrower table to associate each transaction with an identifiable student.
  2. The number of times each student visited our main GCW University Library, using their student ID card to pass through the Library’s access control gates in each of the three* years; taken directly from our ‘Sentry’ access control/turnstile system. These data apply only to the main GCW University Library: there is no access control at the University of Lincoln’s other four campus libraries, so many students have ’0′ for these data. Thanks are due to my colleague Dave Masterson from the Hull Campus Library, who came in early one day, well before any students arrived, in order to break in to the Sentry system and extract this data!
  3. The number of times each student was authenticated against an electronic resource via AthensDA; taken from our Portal server access logs. Although by no means all of our e-resources go via Athens, we’re relying on it as a sort of proxy for e-resource usage more generally. Thanks to Tim Simmonds of the Online Services Team (ICT) for recovering these logs from the UL data archive.

I had also hoped to provide numbers of PC/network logins for the same students for the same three years (as Huddersfield themselves have done), but this proved impossible. We do have network login data from 2007-, but while we can associate logins with PCs in the Library for our current PCs, we can’t say with any confidence whether a login to the network in 2007-2010 occurred within the Library or elsewhere: PCs have just been moved around too much in the last four years.

Student data itself—including the ‘primary key’ of the student account ID—was kindly supplied by our Registry department from the University’s QLS student records management system.

Once we’d gathered all these various datasets together, I prevailed upon Alex Bilbie to collate them into one huge .csv file: this he did by knocking up a quick SQL database on his laptop (he’s that kind of developer), rather than the laborious Excel-heavy approach using nested COUNTIF statements which would have been my solution. (I did have a go at this method—it clearly worked well for at least one of the other LIDP partners—but it my PC nearly melted under the strain.)

The final .csv data has gone to Huddersfield for analysis and a copy is lodged in our Repository for safe keeping. Once the agreement has been made to release the LIDP data under an open licence, I’ll make the Repository copy publicly accessible.

*N.B. In the end, there was no visitor data for the year 2007/08: the access control / visitor data for that year was missing for almost all students. This may correspond to a re-issuing of library access cards for all users around that time, or the data may be missing for some other reason.

LIDP / “Making an Impact” event, 28th June, Leicester

Posted on June 14th, 2011 by Paul Stainthorp

I’m speaking at a CILIP UC&R East Midlands members’ event called “Making an Impact“, on Tuesday, 28 June, at De Montfort University in Leicester, about our involvement in Huddersfield’s JISC-funded Library Impact Data Project (LIDP).

Making an impact: The JISC Library Impact Data Project

Paul Stainthorp will give an overview of the JISC-funded Library Impact Data Project (LIDP). This project, led by the University of Huddersfield, is testing the hypothesis that there is ‘a statistically significant correlation across a number of universities between library activity data and student attainment’. To do this, the team is gathering and analysing library activity data (book loans, gate count figures, e-resource accesses, PC logins) from eight UK university libraries, and comparing that data with student attainment. Paul is the electronic resources librarian at the University of Lincoln and currently project manager for the JISC-funded resource discovery project ‘Jerome’.

Anonymised library activity data for the academic years 2007/08, 2008/09 and 2009/10: collected for the JISC Library Impact Data Project

Posted on June 13th, 2011 by Paul Stainthorp

These data consist of entries for 4,268 anonymised students who graduated from the University of Lincoln with a named award at the end of the academic year 2009/10, along with a selection of their library activity over three years (2007/08, 2008/09, 2009/10): library item circulation, visits to the main GCW University Library, and e-resources usage represented by authentication against AthensDA.

View this item on the University Repository: http://eprints.lincoln.ac.uk/4540/

L to the I to the D to the P

Posted on March 17th, 2011 by Paul Stainthorp

Representatives of the eight partner institutions in the JISC Activity Data LIDP (Library Impact Data Project) met in person (and in Huddersfield) for the first time last week.

Denby Dale from the trainFrom the project blog:

“In a packed agenda we discussed the project in detail – we’ll be blogging the minutes soon.

“We also approved the project plan and discussed the hypothesis in some detail – look out for our first blog on that soon too! We are now working on getting the focus group questions out to everyone in the next few days.”

The original project hypothesis bears repeating here: if we can prove that it stands up, it’s obviously of some significance to libraries in UKHE.

There is a statistically significant correlation across a number of universities between library activity data and student attainment.

N.B. that’s the first and ‘official’ version of the hypothesis, taken from the project proposal. The language may be tightened up a little bit in the final project plan – i.e. what do we mean by “student attainment” – what measurement of attainment are we taking? (It’s degree classification, btw.)

Project Partners:

  1. University of Huddersfield
  2. University of Bradford
  3. De Montfort University
  4. University of Exeter
  5. University of Lincoln
  6. Liverpool John Moores University
  7. University of Salford
  8. Teesside University

Links: