Re-Presenting Badges

5kbadgeYes, it’s another badge post. Feel free to skip, or take a look at some of the other badge-related stuff I’ve posted earlier to get some background.

One of my earliest questions, asked a couple of years ago, about badges and the Open Badge Infrastructure is whether you could put badges into the infrastructure that the issuers didn’t intend (specifically) to go into the OBI. And here we have a great example: the “I walked 5000 steps” badge you see here. When I earned it, via FitBit, it let me share it via Facebook or Twitter, and so I did. Now, on my FB page is a note that I was awarded the badge.

The question is simple. Can you have a “helper app” that takes badges earned on FitBit, or on StackOverflow, or on Four Square (you get the idea), and places them in my badge backpack. Let’s just assume for the moment that these badges, like the FitBit badge, are sitting somewhere out in the open. So, here are some of the questions this raises:

Who owns the badge image

Can I assume, since they are allowing me to put the image on FB, that I can use the image to represent myself in various venues, particularly if the badge is “properly earned”? E.g., is my use above “fair” or am I impinging on their copyright/trademark by using the image? Legally, it seems to me that they could easily claim that they haven’t granted me an explicit license, though I think it would be a mistake to *stop* the flow. After all, why give a badge if you don’t want people to display it? So, at this point, I would say it is an issue of asking forgiveness rather than permission…

More technically, I would assume that the “helper site” would cache the image, rather than providing the OBI with the original image location on, e.g., the FitBit site. That means the helper site would be taking on some liability, but I assume they could easily claim to be a DMCA safe harbor and have appropriate take-down processes?

More generally, the ownership of badge images is likely to become a pretty hot topic. All of the sudden, a lot more people are creating trademarks, and they are likely going to be coming too close to comfort to one another.

Finally, on this topic, I could create a badge that suggests that the FitBit badge was earned, but was my own badge design. At that point, I think there isn’t much FitBit could do to complain. But it would make so much more sense if you could just use the initial badge image.

Are you that person?

The issue of stolen glory is tougher. If you have this middle layer, how does it know you are who you say you are on the other services? If they have some form of data sharing or identity API (e.g., OAuth) there may be ways to “connect” to the account and demonstrate ownership, but these are not universal.

For systems that do not provide an open API for authentication, you would have to play with some kind of work-around to get users to prove they have access to the site. That is possible, but likely too cumbersome to make sense. Luckily, OAuth seems to be more common these days than it once was, and it might be possible to set up a kind of middle layer that helps users on systems that already employ badges move those badges to an OBI backpack. (Some of this could likely be made easier with broad adoption of Persona, but even if I am encouraging my students this semester to set up a Persona account, I’m not going to put too many eggs in that basket until it gets widespread adoption.)

BadgePost2

I unceremoniously killed off the BadgePost system. It was a great learning system, and I can see how it might be useful to others. That said, I think it makes more sense to leverage existing systems. And I like the idea of building a kind of “middle layer” that can draw on badge systems that already exist. I expect my early targets to be:

  • FitBit: why not?
  • FourSquare: Since even people who no longer use it seem to have 4sq badges :).
  • Reddit: They have no badges, really, but we can layer our own on based on karma alone. (Like the Reddit badge for this course, though more automagically generated.)
  • WordPress: There is an OAuth plug-in for WordPress already, and several badge plugins. Should be possible to leverage a WordPress site running the right stack…
Posted in Research, Teaching, Technology | Tagged , , , , , , , , , | 2 Comments

Unresolved this new year

RWS_Tarot_10_Wheel_of_FortuneI have learned a lot in 2012. It’s easy to forget things accomplished, and realize how much you didn’t do. I didn’t get in better shape–quite the opposite. I didn’t produce nearly the amount (or quality) of research I might have wanted. I didn’t make a huge sum of money. I wasn’t the best sort of father or husband I would have liked to have been. I watched too much TV.

I had a few fairly trivial achievements, on various fronts, something my new Faculty Annual Report does a nice job reminding us of on the career side. I learned to have a new disdain for the Phillips head screw. I finally got my tread desk set up. With a great deal of help, I think the association I help run has made some significant improvements. But there has been a bit of learning to do little things better, I think.

It was a year, if anything, of transition. I’ve moved a lot in my life, but the move to Arizona and the purchase of a house here was a much bigger deal than I had expected. And Manhattan and Phoenix are very different places in more ways than the weather. I love a lot about our new home base, but the transition has been far more difficult than I would have expected. I feel deeply uprooted, which is strange for someone with no real roots to speak of. In the end, this year will be remembered mainly for that: “the move.” I hope it will be an inflection point for the better, but to be honest, it’s too soon to tell. I think it was a good move for me, but I don’t know yet if it was the best choice for my family. I am hopeful, though.

For me 2012 is then a year of ambiguity. I’ve laid the Wheel of Fortune; the magic eight ball says “Ask Again Later.”

2013 Tracking

I’m not going to make resolutions; or rather, my resolutions should be apparent in the things I am tracking. I will be keeping a record of:

  • The number of articles or chapters I submit each month
  • Grants applied for
  • The number of blog-posts each month
  • The (self-reported) good class meetings I have
  • Student teaching evaluations
  • The hours spent on various projects (in order to see where effort is best maximized)
  • Food eaten (just opened an account on My Fitness Pal
  • Steps taken (Fitbit is charged, and this time, leashed!)
  • Some other random bits

I don’t have goals for most of these yet–or rather the goals are intentionally fairly mutable. I’ll adjust as I see fit during the year, coming up with different goals, metrics, and categories as we go.

I’ll also keep a list of one-off accomplishments, and things learned, that don’t easily fit into quantification.

I plan to put these together into an Annual Report at the end of the year. This isn’t the first time I’ve planned to do so, but perhaps that’s my single resolution this year: to keep track consistently.

Posted in General | 1 Comment

Do online classes suck?

Before arriving at my current posting, I would have thought the idea that online classes compared poorly to their offline counterparts was one that was slowly and inevitably fading away. But a recent suggestion by a colleague that we might tell incoming freshmen that real students take traditional meatspace courses and those just interested in a diploma go for the online classes caught me a bit off-guard.

I want to be able to argue that online courses are as good as their offline counterparts, but it’s difficult, because we don’t really know that. And this is for a lot of reasons.

The UoP Effect

First, if traditional and elite universities had been the originators of successful online courses and degrees, or if they had promoted those successes better (since I suspect you can find some pretty substantial successes reaching back at least three decades), we wouldn’t have the stigma of the University of Phoenix and its kin. For many, UoP is synonymous with online education, particularly in these parts (i.e., Phoenix).

Is UoP that bad? I don’t know. All I have to judge them on is people I’ve met with UoP degrees (I was not at all impressed), and what I’ve heard from students. What I do know is that they spend a lot of money on advertising and recruiting, and not very much money on faculty, which to me suggests that it is a bad deal.

Many faculty see what UoP and even worse for-profit start-ups are doing and rightly perceive it as a pretty impoverished model for higher education. They rightly worry that if their own university becomes known for online education, it will carry the same stigma a University of Phoenix degree does.

The Adjuncts

At ASU, as with many other research universities, the online courses are far more likely to be taught by contingent faculty rather than core tenure-track faculty, and as a result the students are more likely to end up with the second-string. I’ll apologize for demeaning adjuncts: I know full well that if you stack up the best teachers in any department there is a good chance that adjuncts will be among them, or even predominate. But on average, I suspect that a class taught by an adjunct instructor is simply not as good as one taught by full-time research faculty. There are a lot of reasons for this, but perhaps the most important one is that they do not have the level of support from the university that regular faculty do.

I’ve been told by a colleague here that they wanted to teach in the online program but were told that they were “too expensive” to be employed in that capacity. And there is a model that is beginning to separate out course design, “delivery”(ugh!) or “facilitation,” and evaluation. But I suspect the main reason more full-time faculty don’t teach online is more complicated.

Online is for training, not complex topics

This used to be “Would you trust a brain surgeon with an online degree?” which is actually a pretty odd question. Brain surgeons in some ways have more in common with auto mechanics than they do with engineers, but the point was to test whether you would put yourself in mortal danger if you were claiming online education was good. Given how much surgery is now done using computer-controlled tools, I think some of that question is moot now, but there remains this idea that you can learn how to use Excel online, but you certainly cannot learn about social theory without the give-and-take of a seminar.

It’s a position that is hard for me to argue against, in large part because it’s how almost all of us in academia learned about these things. I too have been taught in that environment, and for the most part, my teaching is in that environment. As one colleague noted, teaching in a physical classroom is something they have been taught how to do and they have honed their craft; they do it really well. Why are they forced to compete for students with online courses when they know they would not be as effective a teacher in that environment?

But in many ways this is a self-fulfilling prophecy. Few schools require “traditional” faculty to teach online, though they may allow or even encourage it. As a result the best teachers are not necessarily trying to figure out how to make online learning great. We are left with the poor substitute of models coming from industry (modules teaching employees why they should wear a hair net) and the cult of the instructional designer.

Instructional Designers

As long as I’ve already insulted adjuncts, I’ll extend to instructional designers. I know a lot of brilliant ones, but the “best practices” make online education into the spoon-feeding idiot-proof nonsense that many faculty think it is. It is as if the worst of college education has been simmered until you get it down to a fine paste, and this paste can be flavored with “subject expertise.” Many are Blackboard personified.

When you receive a call–as I recently did–for proposals to change your course so that it can be graded automatically, using multiple guess exams and the like, it makes you wonder what the administration thinks good teaching is.

I am a systematizer. I love the idea of learning objectives aligned with assessments and all that jazz. But in sitting through a seminar on Quality Matters recently, we found ourselves critiquing a course that encouraged participation on a discussion board. How did discussion align with the learning objectives? It didn’t. OK, let’s reverse engineer it. How can you come up with a learning objective, other than “can discuss matters cogently in an online forum” that encourages the use of discussion-based learning. Frankly, one of the outcomes of discussion is a personalized form of learning, a learning outcome that really comes out as “Please put your own learning outcome here, decided either before or after the class.” Naturally, such a learning outcome won’t sit well with those who follow the traditional mantra of instructional design.

QM has its heart in the right place: it provides a nice guideline for making online courses more usable, and that’s important. But what is vital is making online spaces worthy of big ideas, and not just training exercises.

The Numbers

I like the idea of the MOOC, and frankly, it makes a lot of sense for a lot of courses. It’s funny when people claim their 100-student in-person class is more engaging than a 1,000-student online course. In most cases, this is balderdash. Perhaps it is a different experience for the 10 people who sit up front and talk, but generally, big classes online are better for more students than big classes off.

Now, if you are a good teacher, chances are you do more than lecture-and-test. You get students into small groups, and they work together on meaningful projects, and the like. Guess what: that’s true of the good online instructors as well.

I think you can create courses that scale without reducing them to delivery-and-test. ASU is known for doing large-scale adaptive learning for our basic math courses, for example, and I think there are models for large-scale conversation that can be applied to scalable models for teaching. It requires decentering the instructor–something many of my colleagues are far from comfortable with–but I am convinced highly scalable models for interaction can be developed further. But scalable courses aren’t the only alternative.

I think the Semester Online project, which allows students from a consortium of universities to take specialized small classes online, is a great way to start to break the “online = big” perception. Moreover, you can make small online course materials and interactions open, leading to a kind of TOOC (Tiny Open Online Course) or a Course as a Fishbowl.

Assessment as Essential

I’ll admit, I’m not really a big part of the institutionalized assessment process. But it strikes me as odd that tenure, and our continued employment as professors, is largely based on an assessment of the quality of our research, not just how many papers we put out–though of course, volume isn’t ignored. On the other hand, in almost every department in the US, budgeting and success is based on FTEs: how can you produce more student hours with less faculty hours. Yes, there is recognition for effective and innovative teaching. But when the rubber hits the road, it’s the FTEs that count.

Critics of online education could be at least quieted a bit if there were strong structures of course and program assessment. Not just something that gets thrown out there when accreditation comes up, but something that allowed for the ongoing open assessment of what students were learning in each class. This would change the value proposition, and make us rethink a lot of our decisions. It would also provide a much better basis for deciding on teachers’ effectiveness (although the teacher is only one part of what leads to learning in a course) than student evals alone.

This wouldn’t fix everything. It may very well be that people learn better in small, in-person classrooms, but that it costs too much to do that for every student or for every course. The more likely outcome, it seems to me, is that some people learn some things better online than they do offline. If that’s the case, it would take the air out of the idea that large institutions are pursuing online education just because it is better for their bottom line.

In any case, the idea that we are making serious, long-term investments and decisions in the absence of these kinds of data strikes me as careless. Assessment doesn’t come for free, and there will be people who resist the process, but it seems like a far better metric of success than does butts in seats.

Posted in Teaching | Tagged , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , | 7 Comments

Reddit, Course Discussion, and Badges

This semester I am using a community on Reddit to run my course. I’m certainly not the first to do this. Here, for example, is a subreddit for a Japanese language course, part of the whole University of Reddit project.

Using existing social software for course management is also nothing new. The code that runs Slashdot has been used for course management, and there is a robust community of people using WordPress and other blogs to run their courses. (I’ve done this for well over a decade now.) So, why Reddit?

Over the last few semesters, I have been experimenting with a badge system, tagged on to a home-rolled portfolio structure. It wasn’t really what I intended at the beginning, but it kind of evolved into that. And it looked a heck of a lot like Reddit, once things were said and done.

I got there backwards. My interest was not just in “discussion” but in developing students’ ability to argue, critique, and ultimately, to assess the work of others and their own work. Some of that includes “meta-assessment”–or what otherwise might be considered meta-moderation. This shows up in a lot of online discussion environments these days; Reddit is just one. I think Stack Overflow presents an equally strong contender here, but given the topic of the course, I settled on Reddit.

Both Stack Overflow and Reddit offer their code for download (and expansion, etc.). For now, I think that’s unnecessary. That said, I am wondering how hard it would be to simply layer a badge system on top of Reddit (or a Reddit clone). As I said, I got very near to something that looked like Reddit or Stack Overflow by trying to create a system that allowed users to upload something for peer evaluation. I can imagine a badge system that would observe a particular post on Reddit as a claim to a badge, and evaluate the comments (potentially giving higher weight to those who held expert-level badges in the area), generating a badge that could then show up in someone’s OBadge Backpack

The only tricky part of this might be to make sure that the person claiming to be the poster is actually the poster. That authentication bit (see every IAmA post!) is not obvious or easy, without the user revealing their email. I suppose they could be asked to post using a particular code for “linking” their email to a Reddit user-ID, but this seems more than a little clunky.

This could be done with reddit.com directly without ever touching the code. A browser plugin might actually be able to handle all the UI, as well, leaving the backend on a fairly quiet server somewhere.

Posted in Teaching, Technology | Tagged , , , , , , , , , , , , | 2 Comments