Free Range Assessment

Over the last few months I’ve been keeping a close eye on the development of the (Mozilla and P2PU) School of Webcraft. (Here’s a 103 second introduction.) One reason for this is obvious: I’m interested in how people learn to produce content for the web, and I am interested in teaching using the open web and social technologies. So, it would be hard not to be excited about the School of Webcraft.

But I am also interested because they are engaged in new ways of thinking about assessment and certification. As the name implies, learning in the program is largely peer-to-peer, and assessment needs to follow that model. At the same time, employers and others want to know whether someone is qualified, and we need to have a way of indicating that someone who has been through the school knows their stuff.

This plugs into a larger issue I have with the potential for experimentation in academia. The School of Webcraft is an exciting exception, but it’s really hard to start a school. Much harder than, say, starting a business. Part of the reason for that is that learning and education are hard to do. But there are also some pretty big barriers to entry and these are tied directly to accreditation of learning.

First, students don’t want to go to a school unless they feel pretty comfortable with the quality of the education they will receive. Unfortunately there aren’t a lot of good metrics for this. Accreditation from a traditional accrediting body is one of these. But these bodies tend to be very conservative and focus on process, not on outcomes. I might have a high school or college that can produce much more capable graduates, but if it isn’t accredited, there isn’t an easy way for potential students to know whether their time is well spent.

Equally importantly, the switching costs for students are extremely high if the school isn’t accredited. In other words, not only are they taking a risk on the quality of their education while at the school, even if the quality is great, another school is unlikely to accept their “credits” if it isn’t accredited.

And perhaps the biggest problem of all is the idea that the 4-year degree, in higher ed, is your accreditation to work. It doesn’t even really matter what the degree is in. Wouldn’t it be more sensible–and more fun!–if you could make up your own degree? Yes, many universities have individualized degrees, but what that really means is that you can choose which 40 courses you want to take at that single institution. What if you decide you want to learn how to sail for a year? How does that fit in with your degree? What if you have a natural talent in programming and want to be recognized for that without sitting through ten courses.

I recognize students don’t always know what they need to know, but I think this is only barely a defense of four-year programs designed to teach a “model student” who doesn’t really exist.

So, yes, open educational resources are important, and all sorts of experimenting both inside and outside of traditional institutions is important. But the real power comes when learners can seamlessly move among institutions, building personal learning histories that not only improve their abilities, but make those improvements visible to others.

Posted in Teaching | Tagged , , , , | Leave a comment

In whose name?

Each semester, I ask students to blog publicly. There are many who argue that this is the only way to blog, and although I am not that extreme, I do think it has particular advantages. That said, there are good reasons for and against blogging in your own name. For students who are unsure, I usually urge them toward pseudonymity, though (as you can tell from the URL of this blog) I think that it is probably better–for those willing to take on slightly more risk–to blog in their own name.

The Risks

We should start with the risks, because many find it difficult to assess the risks of blogging in their own name. You have to be willing to accept that what you write will never be able to be fully unwritten. Your current friends, neighbors, and employers will be able to find it. Some make the mistake of assuming that others will never look. That is a possibility, but nothing you should depend on. You should assume that whatever you put on your blog under your own name will be found by the public. Treat it like publishing in a major newspaper–it may not be ordinarily encountered by as many people, but it is findable by just as many people.

And it will be found not just by your contemporaries, but by your great grandchildren. I’ve always said that it won’t be long before we have our first president who had a Facebook account. Along the way, I think and hope we will become more forgiving of various transgressions, but I think this recent article in the New York Times provides some nice examples of how your past stays with you online. Am I particularly proud of papers I wrote when I was still a student? No, but neither am I ashamed of them. Yes, I cringe a little when I see something I wrote when I was a little younger–like this post on fighting blindfolded that I never could have imagined would be sucked up by Google and still accessible nearly two decades later. It’s the same feeling I get when I see photos of myself or hear my voice recorded. But in all, I am willing to risk large chunks of my life being on display, not just to people I know today, but to people a century from now, when tastes have changed, and the word “chunk” in the line above has become offensive. I’m willing to stand by my words and risk not being hired by someone because I’ve mentioned that I am sympathetic to anarchist ideals, or because I like a particular band, or because I teach in a particular way, or because I’ve made stupid errors in spelling, grammar, or thinking.

Blogging under a pseudonym does not remove this possibility. Maintaining your private identity is very difficult to do, and someone with time, resources, or determination can probably ferret out who you are. But not using your own name, or providing too many personal details, can at least reduce this risk.

The Advantages

There are also significant advantages that you potentially give up by blogging under a pseudonym. I suppose the most obvious is that you have an opportunity to shape how people see you. When people Google your name, what do they find? If you are blogging–and your name isn’t particularly common–your blog is likely to show up fairly high on the list of responses. As a result, people I know have been recognized as experts in their fields, and have found opportunities that they might not otherwise have found.

The idea of personal branding still has some icky connotations of self-promotion and egoism. There was a time when only celebrities and public figures needed to manage their public image, that line of thinking goes. I don’t think this is the case. We take showers because most of us do care, even at some minimal level, of what other people think of us. It’s considered an essential piece of being sociable. This sort of impression management has simply grown more digital. So, it makes sense to groom your impression on the web, and blogging and using social media under your own name is a great way to do that.

It also makes you much more trustworthy as a participant in the social web. People want to know you are a real person, and you are standing behind your actions. As Fezzig correctly notes, “People in masks cannot be trusted.”

The Decision

I still advise students to choose a good professional pseudonym when they start out. Given that I think that there are significant professional and personal advantages to engaging in social media under your own name, why do I push them in this direction? There are a few reasons.

At the most extreme end, some of my graduate students are professional journalists, and required by contract not to publish on the web. This runs against my requirements, and puts them in a bind. I ask them to still do this, but to do so under a pseudonym. This bends the rules a bit, but so far, everyone has been fine with that.

You can always go from pseudonym to real name, when you decide to take advantage of those opportunities blogging under your real name brings, but you can never go the other direction. So, the risks are much lower starting out if you choose a name to write and engage under, with the potential of “coming out” down the road.

If your name is John Smith, blogging and engaging under your real name is probably already pretty anonymous. You might actually benefit by instead blogging as “SmithyTheArchitect” since it creates a brand that is findable.

Finally, you can do both. It’s harder to keep things straight, but you can produce material that you are particularly proud of under your own name, and engage in other ways under a pseudonym. Doing so means keeping separate online lives for each identity, which can be supremely difficult, but some choose to go this route.

Naming Right

In the end, I manage to convince about three quarters of students in my courses to engage pseudonymously, and the other quarter use their own names. If you do choose a pseudonym, think seriously about the image you want to project. Corndog1991 may be your handle from way back on AoL, but it might be time to upgrade. Run your name (and domain) by others to make sure you are not missing some obvious connotation, and that it is something memorable and not easily mis-spelled.

In the end, it is your decision: I just want to make sure that you know the risks and rewards–as much as it is possible–at the outset.

Posted in Teaching, Technology | Tagged , | 2 Comments

Video Annotating Socially

You may not have heard about the Video Annotation Socially (VAS) system yet* and so I figured I would try to provide a quick overview.

VAS is basically a way to make comments on a video. If you’ve used the commenting feature on Viddler or on YouTube, you get the general idea, and VAS can be used similarly. It can also allow you to link to images or video from a particular point on the timeline.

You might ask why, with Viddler and YouTube providing these services, another is needed. I’ll give a clear example: what if you want to annotate–as I do for an upcoming course–The Matrix. You can try uploading the film to some of the various video hosting sites, but you won’t get far.

One solution would be to get your own Flash or HTML5-based video player. You could use Flowplayer or Kaltura to either pull comments from a database as the video plays or lay them over the video itself. This doesn’t get you out of the issue of The Matrix, though. If you want thousands of people to comment on it, you will be hosting content that is copyrighted and that will last for all of five minutes.

VAS works by modularizing the process. It consists of three parts:

The first part is an XML file containing associations between particular times in the video–down to fractions of a second–an HTML segment that may contain plain text or HTML markup that links to other resources, and an indication of what File and Time this might be a reply to. The author of the association, and the time the association was made are also included in each annotation. Finally, for the XML document as a whole, there is metadata for the film itself, optionally including the name, year, and similar information, along with a link to a page with more information: IMDB or Wikipedia for example.

Because this is a framework, the VAS structure can be implemented with any player, but it makes sense that its first implementation is built as an interface module on the internet’s friendliest player: VLC. As a practical matter, reading VAS files and displaying them is not dissimilar to any of the half-dozen formats for subtitling that already exist on the web. But because there are more than can possibly be displayed within the film itself, the VAS interface provides a view to the side that is threaded. For textual comments, it fetches the comment and displays it. It is able to thread comments when they are indicated as replies. The interface also allows users to add comments to a current annotation file as they watch the film.

Because the interface can load and view multiple VAS annotation files, it can act as an aggregator. And just as RSS has OPML to link to multiple RSS files, you can aggregate multiple VAS files to that you can view the annotations of everyone, or just your friends and family.

Unlike web-based viewers, however, because VAS uses VLS, you are able to view the film itself in a copyrighted DVD format, layering the annotations on top of the film. For cult classics, you can find and exchange MST3000 style comments, or if you are part of a group of film aficionados you can add your own “if I were the director” tracks. The uses for education are limitless.

* You probably haven’t heard of it because it doesn’t exist. Won’t someone create it, or suggest ways that it can be done with existing software?

Posted in Technology | Tagged , , , , | Leave a comment

Does Adlai Stevenson matter?

There is a great “fluff” piece over at the New York Times detailing the provenance of dorm rooms at a few schools. It includes a photograph of four freshmen at Princeton who, when told they were occupying Adlai Stevenson’s old dorm room replied that they didn’t know who the guy was but that “there’s famous people in every place” at Princeton.

Predictably, the comments bemoan the state of modern education. If Princeton represents our best and brightest, how sad is it that they don’t know who Stevenson is? After several comments in agreement, the backlash begins. Should freshmen know every defeated presidential contender over the last five decades? Inevitably, someone posts that they don’t need to know because they can always look up his bio on Wikipedia.

You probably think you know where I come down on this. After all, I’ve suggested many times before that the nature of knowledge is changing, and that formal expectations of what people should know is changing. That said, I am a little disappointed that these four were not aware of Stevenson. I wouldn’t expect them to be able to provide the details of his biography (after all, that is what Wikipedia is for), but I would expect them to have at least a rough idea of how he fits into the fabric of our history. In other words, I would expect that in their studies before reaching university, they might have already had the opportunity to look up his bio on Wikipedia, and might remember enough to know roughly who he was and why he was “famous.”

The fact that these things exist outside of our heads is only an advantage if we actually use them. Most of what I’ve learned I’ve forgotten, but it leaves some indexical trace, some broad map of the world that will allow me to reacquire these things in the future. So the question is how our most elite student manage to get through high school without ever finding the need to google Adlai Stevenson, and how we can change that.

I’m convinced that part of the reason they never ran into Stevenson is that he doesn’t make a big splash in the textbooks. The fault isn’t in a particular textbook, or even the Texans who decide what counts as history, but in the existence of textbooks at all. Textbooks, and the tests and regents exams they spawn, focus on sufficient knowledge: if it isn’t in the book, it doesn’t matter. The work of a school, no matter at what level, is to create the conditions that lead students to discover things on their own. And somewhere are the conditions under which a student will encounter Adlai Stevenson as more than a presidential loser.

Posted in Teaching | Tagged , , , , , , | Leave a comment

The New University Press

The future of the book, and of the publishing industry, has far less to do with what you produce, and far more to do with enabling an ongoing conversation. This isn’t news to any of you, you live it. But it’s easy, in the midst of a project, to get seduced by the myth that all you do is take ideas and make them into physical objects. The work of scholarly publishing begins and ends in conversation, and always has.

Digitizing my personal library

Where does this leave books? I love books. In fact, I may love books too much. Each time I’ve moved, books made up 90% of the weight of the move; far more than that in my moves to and from Japan. I’m still paying off credit card bills for books I bought years ago and haven’t yet had time to read.

When I first started to rip my library, it didn’t come easily. Unlike ripping CDs, for most of my library going digital means literally ripping: destroying books in the process of scanning them. Even describing this process feels a bit—and this isn’t hyperbole—blasphemous. This is probably different for a publisher—after all, many of you end up destroying books as a matter of your trade—but for me, it is still not an easy thing to do.

First I cut the boards off, and then slice the bindings. I have tried a table saw, but a cheap stack cutter works better. Then I feed them into my little page-fed scanner, OCR them (imperfectly) in Acrobat, and back them up to a small networked attached storage device. This is a slow process: I only manage a few hundred books a year, at best. I’ve only just started experimenting with non-destructive scanning. My hope is that the industry and technology will catch up enough that I don’t have to keep this up.

So why am I doing it? There are lots of reasons. One is simply a matter of space. I live in a Manhattan apartment and have a one-year-old. I suggested to my partner that we keep the room we use as a library and let him sleep in the closet, but this didn’t go over well. More importantly, my home and my school office are now a sizable commute away from each other. It was hard enough to decide which books should go where when I lived only a few minutes from the university, but now it’s even more important that I can get at my library at either location. More to the point, I work with research groups on two coasts of the US, and spend a decent amount of time on the road or in the field. I need to be able to access not just journals, but books when I am travelling.

The second reason is that although I still do read books, starting on one end and ending at the other, I just as frequently “gut” them, reading the bits that I find most useful, often out of order, often in conjunction with other bits from other books. These days, when looking for something, I am less likely to page through a book than I am to do a keyword search. Even for the books that are not yet scanned, if Google Books has scanned them I can search them for a phrase half-remembered, find the page, and then pull it down from my shelves. My primary use of books these days is not to engage with them individually, but to see how they engage with the other books in my library and in my head.

My hope is that one day I can do even more with this. That I can move beyond keyword searching to do some level of concept mapping and networking authors’ ideas and citations. Maybe even imposing new structures—geographic, chronological, or social—that were not originally present. That day isn’t here yet, but having the books in a fungible form is a necessary prerequisite.

It’s worth noting here the things that I cannot do, because it’s important. I can no longer share my books with students and colleagues. Or rather I can, but if I do I tread on uncomfortably unstable legal ground. No one would object to my lending a book to a friend, but lending them the PDF of a book I’ve purchased is another question. As a result, my private library is essentially even more private than when I started. Which brings us to the field of digital humanities …

Digital Humanities

I worry about the term digital humanities. The word “digital” just seems so 2010. I haven’t yet run into someone who refers to themselves as an “analog humanist.” Moreover, I’m not really trained as a humanist, and so I feel a little awkward in saying what it is they (and sometimes I) do. But it’s interesting in part because humanists are traditionally held up as the last, most conservative bastion of bookishness—sort of the edge on the other end of biologists and physicists.

It’s clear that humanists work with texts. All academics work with texts, of course; scholarship is based in production and exchange of texts—otherwise it is not scholarship. But humanists also work with the idea of working with texts, and for that reason they have what may be a privileged perspective on the transition of scholarship in a networked world. And particularly important in this transition is a movement toward transliteracy, and an acceptance of the idea that scholarly expression happens on different platforms in different ways at different times and that ideas form pathways through these platforms.

The book—in its traditional ink on dead-trees format—remains one of these platforms. And I expect that in twenty years, I will still be able to walk into my local bookshop and plonk down a hundred dollars for a beautifully printed and bound book. After all, Western Union missed the boat on telephony and the internet, and still didn’t send its last telegram until 2006. Media have staying power. It’s true that I see Kindles and other electronic readers more frequently than bound books on flights these days, but there remain certain books that I will want to keep in bound form, for myself and for my son.

And even as the book is changing form, that change is not radical. Most of the ebooks we are talking about are really not that different than what we’ve been doing for two hundred years. And for those of us who write books, it’s a non-step. After all, we provide you with an e-manuscript, in the vast majority of cases. The step to electronic books is actually a pretty small one, though it is important in what it enables.

For the digital humanities, it has opened up new scales of analysis. The model of one person and one book is no longer the only way. Texts are no longer found only in books, and understanding them can be done in ways besides deep reading. None of this removes the possibility of studying books, or of studying them by reading them carefully and deeply. But having the material in electronic format allows for new perspectives, both by examining work at micro scales—the study of stylistics, for example—and at macro scales—the networking of books in a wider literature.

I’m most interested, however, in the ways in which making books electronic provides the opportunity to link them to other kinds of conversations that exist in the online world. Before talking a bit about what kinds of conversations I mean, I should pause for a moment to talk about whether we are all becoming a bit too shallow.

Your Brain Without Books

Nicholas Carr is in the news a lot lately promoting his new book, The Shallows. I had dinner with John Seeley Brown last week and he admitted he really couldn’t get further than the first few pages in the book. It’s easy to toss that off as situational irony, but I also have done no more than skim his new book, because once I noted some of the conclusions he was drawing from his evidence, I honestly found it not worth my time to engage it more deeply. I could learn more by investing my attention elsewhere.

He suggests that in order to write the book, he stopped following Facebook and Twitter. He relates what anyone who writes has known for many years: if you want to write, it’s good to shape your informational environment appropriately. In fact, I would suggest if you want to remain undistracted, a traditional library is perhaps the worst place to be. I’ve wasted hours at libraries and bookstores—wasted them enjoyably, but wasted them nonetheless.

This is not an argument against books; again, I am a book lover. But it is important, I think, to notice that books are a particular kind of conversation—and a peculiar one at that. If I were to tell you that I planned to talk to you today for three hours—and be assured, as a professor, I am perfectly capable of sustaining a three hour talk—most of you would walk out the door. One of the nice things about a book is precisely that you don’t have to read it deeply, that it is open to other uses, and that you can gut it intellectually just as easily as I am gutting my books physically.

Publishing

This will be my first visit to the AAUP conference, and I don’t tend to spend a lot of time with those in the publishing industry. I guess I hold out some romantic hope that I will see some ink-stained hands, but I’m not counting on it. Some university presses may actually retain printing & binding facilities in-house, but I am also sure that is pretty unusual. At the other end, bookstores are now printing on demand, which raises the question of what a “press” does. It is far too easy to get tied up in the idea of product, when the only reason presses continue to exist is because of what they do really well: process.

Dan Cohen has a great blog post in which he discusses the social contract surrounding the book, one in which authors work with publishers to put together a work that is thoroughly researched, well structured, and presented well in terms of language and visual design. The readers, in turn, enter into the contract by being willing to attend to the work seriously, think about it, and incorporate it into their own work. He goes on to suggest that some of the elements of this contract, and particularly the fact that it allows for only one genre of scholarly communication, are flawed, but that the idea of a social contract between author and reader is not. It’s a matter of evolving that contract.

Part of that evolution is to recognize that the process of the book is as important as the product, and that a book finds its success in that process, and in the conversation that happens around that process. I don’t buy that many books these days, but I can tell you some that I know that I will. I know I’m going to buy Kathleen Fitzpatrick’s Planned Obsolescence and Siva Vaidhyanathan’s Googlization of Everything. Both of these books were presented to the world before they were entirely baked, and are being reviewed openly by peers ahead of publication. Of course, we have always shared manuscripts and email has made this easier. But by making the process even more transparent, there is an opportunity for this to extend beyond the constraints of personal social networks. I’ll say more about that in a moment, because it is important. The other book I’m going to be buying is Hacking the Academy. The initial draft of this was written in seven days by a distributed group of over 200 authors who tagged their posts with a common hashtag. This is now being edited together to be presented as a cohesive work.

Part of the reason that I’m going to be buying these books is that I am already connected to them, before they have ever been printed. I’ve read the work in blog posts and in tweets, in conversations both in real life and online. To be crass about it, it is about the best possible marketing for a book you can imagine. It’s cheap, honest, and effective.

And the connections will extend beyond the physical manifestation of the books. Books are great for a lot of reasons: you can read them in the bath, you can cite them and know they will not change their mind, they work during power outages. But they also tend to freeze conversation in time and be difficult to update. Of course, it’s an author’s responsibility to make their text timeless, but timeless texts are not always good for scholarship. We may be reading Plato’s words a couple of millennia after he drank himself to death, but if he were around, he’d likely be the first to tell us we’re doing it wrong.

The ability to open up and recontextualize—even when that does not immediately happen—is vital. It futureproofs a text, and makes it more likely to be taken up by later authors and in later conversations. This means asking at each step in the process, Can this be more open? Can we invite more people to this conversation?

These are precisely the kinds of questions that are being asked in other places where scholarly communication happens. At conferences, folks are sharing work before, during, and after. I’m working with the Digital Media and Learning Hub at UCHRI to try to create a collaboratory that provides a virtual space for researchers to talk more openly with their peers about work currently underway. It’s unfortunate that the publishing process is often is seen as somehow an appendage to these conversations rather than being a partner from the outset. I can understand why this might be the case for mass-printed trade fiction, for example, where the audience might be more clearly disjoint from the authors, but it certainly does not make any sense in the academy, where presses cannot afford to remain on the margins.

The unbinding and reconnecting of texts across media ultimately has little to do with texts and everything to do with people. The creation of a book is a social process. When people begin to talk about the ways in which the internet has changed publishing they think of the web as largely a publishing platform, which is fair enough. But the real changes are in how people connect, how they maintain relationships, how they work together, and how they coalesce into publics.

The process of the book is intimately tied to these networks. When I write a book, I certainly don’t do it to make money—I’m in the wrong business for that. I do it in part to get attention for some ideas that I think are important. But I do it most of all as a kind of dating profile, an indication of the kinds of things I’m interested in, with the hope that I can meet other scholars who share my interests. In other words, the social network isn’t just the most important input into the book process, it is the most important outcome.

Game Plan

What does this mean from a practical perspective? It means drawing on what you already do well. You already have to make decisions about what is important in a field, who has ideas worth sharing, and coordinating the review process. You already, across the board, are able to organize and schedule review and production processes. You already are creating some conversation around your books by creating a web presence and connecting with various publics. In other words, you’re already doing a lot of the things you need to, it just seems to be unevenly distributed.

The first thing you need to be doing more of is monitoring the environment, sharing with your colleagues things that work and things that don’t. I have no doubt that most of you are already following some of the things that are happening with the projects I mentioned earlier. It’s important that as you create your own projects, you are keeping your colleagues aware of these, and recording both successes and failures. This conference is a great start—but a once a year update isn’t good enough. Make sure those in your personal networks know what you are doing, and you know what they are doing. Make sure that scholars in your field are part of that network as well.

Second, connect at a much deeper level with those in the fields you work with. Some of you have acquisitions editors who are very good at networking in the old sense, and getting to know the leaders in a field. You need to go beyond this and look for and foster the new leaders. That means tracking those early in their careers—particularly those who are leading the charge in new forms of scholarly communication. Scholarly associations play an important role here, and I suspect they will continue to do so. But it isn’t enough to follow their lead. If you want to show your value, you need to show that you can innovate, and that you aren’t just adding your name and imprimatur to innovations supported by scholarly associations, universities, and funding agencies.

In the end, you need to look seriously at your value proposition. What can you bring to the table? What can you add to networked scholarly discussion? I know that there are a lot of bright folks in publishing, and that you have a great deal of experience and intellectual capital to bring forward. I also know that some of you are content to coast on your names for as long as possible, hoping to wait until the wind has shifted before hoisting your own sails.

Don’t Watch Your Polls

I’ve talked a little bit of what I think university presses should be doing to move scholarly communication forward. I cannot say that I represent the average scholar in my field or in any field. Everything I have seen suggests to me that while we may indeed drink lattes and drive Volvos, academics tend to be conservative in many ways. We are conservative in part because we work in institutions that update medieval traditions with twentieth-century bureaucracy. I’ve yet to hear a tenure committee say “We like the two books you published with Oxford University Press, but that blog post really wowed us.”

On the other hand, change doesn’t come from the center. Many of you are concerned about the future of scholarly publishing, and you should be. But don’t look to academics to lead the way alone, and don’t assume that you can rely on a second-mover advantage. There are still successful music labels and newspaper publishers, but they didn’t get there by waiting out the storm. Success over the next five years is pinned to a willingness to take risks, open up texts, and create new spaces for conversation.

Finally, can we get over the “books are (not) dead” trope? It’s boring. Scholarly communication is thriving today more than ever in history. We are in the midst of a new Renaissance, and university presses find themselves at the center of that revolution. Please don’t waste your good fortune or the opportunities around you.

[In case it isn't obvious, the above is the text of a talk I planned to give to the Association of American University Presses meeting. I ended up presenting something that only vaguely resembled this, but you get the idea. ]

Posted in Research | Tagged , , , , , | 2 Comments

Rethinking the human subjects process

Get a group of social scientists together to talk about prospective research and it won’t take long before the conversation turns to the question of human subjects board approval. Most researchers have a war story, and all have an opinion of the Institutional Review Board (IRB), the committee in US universities that must approve any planned investigation to make certain that the subjects of the research are protected. Before too long, someone will suggest doing away with the IRB, or avoiding human subjects altogether.

Research in the field of Digital Media and Learning (DML) tends to focus on youth participants, occur in dynamic, mediated environments, and often consists of researchers working in different locations and sharing their observations. All of these factors can complicate the process of seeking and receiving approval from local IRBs, leading to a substantial amount of effort by researchers and unnecessary delay in doing good research. Particularly vexing is the difficulty in sharing data among researchers at different universities, a vital prerequisite to collaborative social science. In the hope of improving this process for everyone involved—the researchers, members of the IRBs, the participants in the research, and the public at large—the Digital Media and Learning Research Hub supported the first of a pair of one-day workshops intended to discuss potential solutions. A number of groups have been looking at how IRBs are working and how they might work better, and we were lucky to be able to bring to Irvine a group of people with significant experience working with the IRB process in various contexts, including Tom Boellstorff, Alex Halavais, Heather Horst, Montana Miller, Dan Perkel, Ivor Pritchard, Jason Schultz, Laura Stark, and Michael Zimmer. Each of the participants shared their research and other materials with the group beforehand, as did others who were unable to join us.

We found that while there might be some fairly intractable issues, as there are for any established institution, some of the difficulties that IRBs and investigators encountered were a result of reinventing the wheel locally, and a general lack of transparency in the process of approving human subjects research. The elements required to make good decisions on planned research tend to be obscure and unevenly distributed across IRBs. From shared vocabularies between IRBs and investigators, to knowledge of social computing contexts, to a clear understanding of the regulations and empirical evidence of risk, many of the elements that delay the approval of protocols and frustrate researchers and IRBs could be addressed if the information necessary was more widely accessible and easily discoverable.

Rather than encouraging the creation of national or other centralized IRBs, more awareness and transparency would allow local solutions to be shared widely. Essentially, this is a problem of networked learning: how is it that investigators, IRB members, and administrators can come quickly to terms with the best practices in DML research? Not surprisingly, we think digital media in some form can be helpful in that process of learning.

The devil is in the details. First, it’s important to identify what should be shared, how to share that information in a way that is most helpful, and how to get from where we are now to that point. Much of this information sharing already takes place today informally, with colleagues contacting one another for advice on protocols, technologies, and the like. Our hope is to create a resource that opens this sharing up a bit more, highlights a core set of ideas held commonly in the disciplines that make up DML, and makes the IRB process quicker and more effective.

As a group we would love to hear your suggestions on how best to improve the IRB process, or questions you might have in the.

NB: This post originally appeared on DMLcentral. Please make any comments there.

Posted in Research | Tagged , , , , | Comments closed

Boston Globe Narrows Focus


Boston Globe Tailors Print Edition For Three Remaining Subscribers

Posted in Technology | Tagged | Leave a comment
  • Tweets

    Error: Twitter did not respond. Please wait a few minutes and refresh this page.

  • Archives