On evaluation design pt 2.

Third set of principles

The other thing to remember is that even if you’re leading the evaluation, it’s not your evaluation. One thing you don’t want to create is an “us and them” division within a project, where teachers provide data for the researchers. Education research should be designed with the end user in mind, which is educators, and they know better what they need to know. And everyone in the project is bound to have a good idea about research questions (I refrained from saying “better idea” but that’s probably true too). So the research questions, survey design, sources of data, all need to be collaboratively created, with practitioners and (if they’re interested) students. If there are other practitioners who want to contribute to the evaluation and writing of the report and any papers coming out of the project, they also have a right to do that, and should be included. I know of some projects (none I’ve been involved with thankfully) where academics have just gone to ground with the results and months later have a paper published, without offering anyone else within the project the opportunity to be involved and get a publication out of it. Which isn’t on. The AMORES project brought some of the schoolchildren along to the final conference. This shouldn’t really be exceptional, but it still is. Arguably it’s the learners who are the rationale behind doing all of the research in the first place. (Competing arguments are that it’s our mortgage lenders who are the rationale for doing it, but that’s another post entirely).

So .. #3 evaluation design should be Egalitarian, Inclusive, participative.

Now would be a good time to mention ethics, probably as it brings together all of the principles we’ve discussed so far.

Obviously everyone who takes part in the project needs to be protected. Everyone has the right to anonymity if they are taking part, so usually I get students to adopt a pseudonym for all interactions. There’s a piece of paper somewhere that matches pseudonym to real name (in case the student forgets and needs to look it up) but that never goes online and never leaves the classroom. Protecting the identities of staff is also important if that’s what they want, but also acknowledging their participation if that’s what they want too. Just remember to ask which it is. But ethics is really the underlying reason why you want the evaluation to be useful (you’re obliged ethically to put something back into the sector if you’re taking time and resources from it) and to be egalitarian (everyone deserves a chance to be published and have a creative input to the process.

So #4 Be ethical

The fifth set of principles are possibly the most difficult to put in place. Up to now every previous principle put in place has led to a whole set of different data, from different sources, that just happen to be around, contributed by and perhaps analysed by, a lot of different people. At this stage, it could be seen to be a bit of a mess.

However, that’s where the skill of the evaluator comes into its own. It’s taking these disparate sets of data, and looking for commonalities, differences, comparisons, and even single case studies that stand out and elucidate an area on their own. The strength of having such disparate sets of data are that they are :

#5.1 eclectic, multimodal, mixed methodologically,

However, it’s still necessary to put a minimum (remember, light touch) more robust evaluation in place at the core, in the form of a survey/questionnaire etc. This needs to contain a pre- and post-test and be open to quantitative analysis (some people only take numbers seriously). This runs against the idea of aligned with practice and opportunistic, as it’s an imposed minimum participation, but I think as long as it’s not too onerous, it’s not too much to ask. Usually though, this is the bit that requires the most struggle to get done.

So .. #5.2  quantitative comparative analysis, demanding minimum imposed involvement from practitioners to complete, provides an essential safeguard to the research to ensure robustness

However, this is not the only robust aspect. Even though the remainder of the data are opportunistic, because they are so wide-ranging they will inevitably provide qualitative data in sufficient quantity (and be triangulated), that this would in itself be an effective evaluation. It’s just good to have some numbers in there too.

To make the best of these elements, post-hoc, is the most difficult aspect of this style of evaluation, and requires a bit of time just sifting through everything and working out what it is you’ve actually got. Allow a week without actually getting anything concrete done. It’s OK, it’s just part of the process. It requires the evaluator synthesise the findings from each set of data and therefore to be

#5.3 flexible, creative, patient

As Douglas Adams once said (though he was quoting Gene Fowler) “Writing is easy. All you do is stare at a blank sheet of paper until drops of blood form on your forehead.”


Finally the outputs. Both the BIM Hub project and the AMORES project have the same two sets of evaluation reports. Given the aims of the project to be both useful, and robust methodologically, I think having the outputs in these two forms is essential.

Typically these two forms are:

A “how to” guide – the AMORES one is at this link:


The BIM Hub one is here:


Both of these summarise the key points of learning from the project, in a form that practitioners can adopt this learning and incorporate it into their own practice.

However, backing up these documents are fuller evaluation reports detailing the data and analysis and showing how these points of learning were arrived at, and providing the evidential basis for making the claims. This isn’t essential for people to read, but these documents do provide the authority for the statements made in the summary documents.

Finally both projects also include visual materials that contribute to the evidence. In the BIM Hub project, this is recordings of the meetings the students held, showing how their abilities developed over time. For the AMORES project there are dozens of examples of the students’ digital artefacts. In short, when you’re publishing the evaluation you also want to reassure your audience that you haven’t just made the whole thing up.

i.e. The final principle generate artefacts during the project so that at the end you can: show that it is a real project, with real students, doing real stuff







On evaluation design pt 1.

Some thoughts on my approach to evaluation design

I’ve just finished another internal evaluation of a project. This time it’s the AMORES project http://www.amores-project.eu/ Reflecting on the evaluation, and the similarities with the previous evaluation I did, led me to some realisations about the sort of evaluations I conduct, how they are designed, and what their essential elements are. I thought I’d collect these together into a couple of blog posts, mainly so that the next time I design one, I can remember the best of what I did before.

I should specify that I’m discussing particularly internal evaluation. For those not familiar with educational projects, most of them have two evaluation strands. One is the external evaluation; this is conducted by someone outside of the project who examines how well the project functioned, whether it met its goals or not, how well communications worked within it, and so on. It’s part of the Quality Assurance, compliance and accountability process.

The internal evaluation asks questions of the learners, teachers and anyone else involved with the educational aspects to identify good practice, look for tips that can be passed on, and encapsulate the overall experience for the learners and educators. In short, it’s there to answer the research questions addressed by the project.

There’s a good deal of overlap between the two, but they are essentially different things, and should be done by different people. You merge the two at your peril, as part of the external evaluation is to address the success of the internal evaluation. And you do really need both to be done.

I’ve been the internal evaluator on 13 education projects now, but the last two (the other one was the BIM Hub project http://bim-hub.lboro.ac.uk/) were very similar in evaluation design; I think I’ve cracked the essential elements of what an internal evaluation should look like.

Part of the issue with being an internal evaluator is that, even though you’re part of the project team, you’re not (usually) one of the teachers. And teachers on projects have their own agenda, which is to teach (obviously) and, quite rightly, this takes precedence over all the analysis, research and general nosiness that a researcher wants to conduct.

For this reason, an evaluation design needs to be as unobtrusive as possible. Most education activities generate a lot of data in themselves, artefacts, essays, recordings of teaching sessions, all of these can be used without placing any additional burden on the learners or teachers. Sometimes the evaluation can drive some of the learning activities. So, for example, you need students’ perceptions of their learning; so you set as an assignment a reflective essay. You need something to disseminate, so you set students the task of creating a video about their experiences, which can also be evaluation data. And when we’ve done this, not only does this prove to be a very useful set of data, it also becomes an excellent learning opportunity for the students. Teaching generates a lot of data already, too, such as grades, results of literacy testing, pupil premium figures, tracer studies. As long as the institution releases the data, then this is stuff you can use with no impact on the learners or teachers.

So here’s the first set of criteria. Evaluations must be:

Unobtrusive, opportunistic, aligned with teaching practice

The second set of criteria is related to actually having an evaluation that makes sense. There’s no point gathering a set of data that are more than you can deal with (having said that, every project I’ve done has). Also the data you collect have to be targeted towards finding out something that will be of use to other practitioners once you’ve finished the project (I’ll come to outputs later). The RUFDATA approach is a good one here. There’s also no point trying to gather so many data that no-one will look at the surveys you’re distributing, or complete them if they start them. For length of survey principles that seem to work are:

Quantitative questions – no more than one page (and use a 5-point Lykert scale obviously – anything else looks ridiculous – but add “don’t know” and “N/A” as options too.

Free text questions: well no-one wants to write an essay, and if it’s on paper you’ll have to transcribe them at some point anyway. As far as numbers go, a good rule of thumb is that if it’s a number you’d see in a movie title it’s OK. So seven, or a dozen, or even 13, is fine. More than that is pushing it (and if you’re going to ask about 451 or 1138 questions then full marks for movie trivia, but minus several million for being a smart arse. The point of the movie title thing is that if you see your research questions as characters in the narrative you’re going to weave, then you don’t want to overcrowd your story anyway. Putting too many in then becomes pointless. You want all your questions to be Yul Brynners, rather than Brad Dexters.

So: useful, targeted, light touch, practicable

A third set of principles is based around whose research is it anyway? Which will be covered when we reconvene in the next post.












Joining Brookes

As I’ve just started working as a Senior Lecturer in OCSLD (the Oxford Centre for Staff and Learning Development) at Oxford Brookes I felt it was time to start blogging regularly (not trying to blog, do or do not, there is no try). As there’s not much yet to report about my work there, this first one is more about where I’m at, and why the change, and what changes are likely to be coming up.

I’ve posted a lot on my Facebook account about these changes using the metaphor of The New 52. Having reached 52 years old this year, this feels like a mid-way point in my life (optimistic, right?), so out with the Old 52 and in with the New. Any mainstream comics fans will recognise the metaphor, a few years ago DC Comics rebooted its whole line under the banner of the New 52. Every comic started again from #1 – even the ones that had been going for 73 years. After four years of working as a “freelance academic” I wanted a reboot. A proper job in which I had a team of people to work with, a platform in which to share my ideas, and some regularity of income so I could focus on work, rather than being distracted by the need to find more work, or chasing clients in order to get paid for work I’d completed.

Also consultancy work is excellent, you meet loads of people, get to travel to some interesting places, but an academic career really survives on publishing research, and as a self-employed consultant, any time you spend writing is a financial cost. It’s one thing to write for free, it’s another for it to cost personally hundreds or thousands of pounds to take the time out to write a book chapter.

It’s not like I worked on my own before the Brookes job came up – the team on the AMORES project are an excellent team, for example, but they’re distributed across Europe and we only meet four times a year. My daily interactions are predominantly with my cats. And it’s ironic, I know, or perhaps hypocritical, to mainly work (at the moment) on how best to facilitate online teamworking and then bemoan the fact that I entirely work online with people.

However, I would never argue that face-to-face collaboration is entirely able to be substituted with online interactions. However, I am enough of an extrovert to need the communication with people to feel motivated by talking to others. I’m also enough of an introvert to need to work on my own after a couple of days of interaction. A 0.6 fte post is therefore ideal for me. I’ll still be teaching at Worcester until January, and I’ll still be working for a few clients.

However, anyone familiar with the New 52 metaphor will know that any reboot is preceded by a Crisis (deliberately capitalised cf. https://en.wikipedia.org/wiki/Crisis_%28DC_Comics%29) .

My flashpoint was the double whammy of my brother-in-law dying (the day before my 52nd birthday) and then my father dying two weeks later. The sheer admin involved is overwhelming, but of course it’s the emotional fallout that really has the impact.

September and October was the key month for me in AMORES (I’m leading the evaluation workpackage, and as everyone who will listen to me knows, without any evaluation there IS no project) and I’d planned for the majority of my commitment to be done with before I started at Brookes. It didn’t get done. I’m still contracted to work on AMORES until the end of November, but the original intention was that it should be some small bits of dissemination, not writing the actual whole thing. So my family, my wife’s family, my AMORES commitments all collided with my new job; in the collision of parallel worlds you’d expect from a capital-C Crisis.

However, it was a good test of how accommodating my employer (errm still got a bit of a culture shock at that word) would be with allowing me time to respond to all the various intruding realities. Last week saw the completion of the AMORES report (180 count ’em 180 pages long) the spreading of my father’s ashes (which ended up a farcical rather than solemn occasion) and everything is now sort of coming together on an even keel.

My main roles are to help implement the TEL framework here, and support the development of the OCSLD’s online presence. I’m also co-tutoring on a couple of modules. More things will emerge as I’m here longer. I will just keep stepping up and try to make myself useful. Make myself useful (no try, remember).

I’ve got an ID card and a car park pass, but then I have four others of these from clients when i was self-employed. What is exciting is my own desk, an office key, my own stapler and desk tidy and TWO hole punches.

Just in time for my honeymoon in Vietnam starting on Saturday (for two weeks). Then a conference in Dubrovnik (one week). So more testing of OCSLD’s patience.

I will be at ECEL http://academic-conferences.org/ecel/ecel2015/ecel15-home.htm presenting the hot-off-the-press findings on AMORES. If you’re there then please come up and say hello.

Is it wrong to discriminate against assholes?

I’ve just read this? http://www.economist.com/news/international/21645759-boys-are-being-outclassed-girls-both-school-and-university-and-thegap Which makes interesting reading. It does raise the question for me though – is this really a problem? The generalisations they are making about the sexes (which the article admits are generalisations) are that on the whole girls are hard-working ambitious and studious whereas boys are lazy, aggressive and in awe of a cult of masculinity which states that being academic is effeminate (to put it mildly).

These are generalisations though. Many boys aren’t into a macho culture (or are so socially inept they are oblivious to the fact that there is one – author disclosure: that was the category I was in), many girls are pretty dreadful.

The implicit undercurrent in the article is that this is a problem in education that we need to fix. Boys are underachieving compared to girls, but that is when you take them as a whole. I’d be very interested in seeing a study in which the divisor isn’t boy/girl but asshole/non-asshole (explanation: I’d think someone who buys into macho [or macha] stereotypes is behaving pretty horrendously and so therefore fulfil this definition).

The gender gap could be actually just because a bigger percentage of boys are assholes than girls. If we try this new divisor we might see no gender gap at all. Just that the system is, quite reasonably, making it more difficult for people to get on because they’re complete knobheads, which they possibly deserve, and rewarding the good kids because that’s what they deserve.

Continuing this line of reasoning, therefore, we don’t look at different ways within the system to appeal to the knobheads out there, we actually try and make social changes to reduce the number of knobheads in the education system – combat the culture of masculinity that says being studious is effeminate (or even that actually effeminacy is not such a bad thing).

Having said that, attempting a range of different learning approaches is (intrinsically and self-evidently) A Good Thing, so in the attempts to appeal to the less able, or less interested students, we’d be making education better for everyone. A lot of children are disaffected because they are bored, which is also a very rational and intelligent response. That’s down to us. But maybe the gender divide in education is down to them.


The role of the teacher in learning environments

I recently was asked in Facebook by my friend Di – “I keep mulling around the importance of the practitioner as the key defining resource in learning… feeling very ‘anti’ commodification of education blah, blah again – is this anything you would be interested in? do you hit on anything like this? Would be very cool to look at how manipulation of new learning environments can be linked back to the centrality of the teacher in the educational process? Possibly? Maybe? Has it been done?” It’s a good question – in the debate on VLEs (or I prefer the US phrase LMS since it seems more honest to refer to them as a way to “manage” learning) on an ALT mailing list someone said that a lot of the problems with Blackboard spring from it being designed by technologists rather than pedagogues. Probably true, but the thing that indicates that teachers are still at the centre of the learning experience is that, no matter how bad the platform a good teacher can produce a good learning experience, and a no matter how great the platform, a bad teacher will create a bad one. I’ll concede the tech helps one way or another, though. This is why criticisms of PowerPoint cheese me off. PowerPoint is a passive tool, if you use it well it’s great – it’s just that too many people (and I could probably own up to this myself) use it as a prop to avoid thinking too much about the learning experience. So they produce crap. And so they switch to Prezi because they think this’ll make them look hip, and for a while people are impressed until they realise it’s the same dull presentation, just with added motion sickness.

But Di’s central implicit point I’m sure is – is it fair to say that new learning environments have been exploited to commodify education. The answer is “yes” unfortunately. I’ve been at meetings where people who should know better talk about putting stuff online so they can bring in thousands of students really cheaply. I’ve just finished a study which indicates that – outside of a few rare contexts where they can work, MOOCs do not have a sustainable business model. Students want education that is free, but they also want education that is valued, and that means qualifications. But for qualifications to mean anything, they need robust assessment, and (there are a few specific exceptions) this means human intervention. Which is expensive. That’s a circle you can’t square. Some people like to study for its own sake, some people like to create learning materials for their own sake. In those scenarios MOOCs FTW. Otherwise, no way.

There is a school of thought that you can make the materials able to be worked through on their own, that people can read them and just pay to pass a test, and this will bring education to the masses, and everyone will be able to make money off it by stacking edcucation high and selling them cheap. This is the commodification that Di’s concerned about. It’s been the model in the private sector for decades. (Reality check – the division I’m about to describe is a generalisation, I’ve seen good and practice on both sides, but my experience is that this does represent the two positions of the two sectors on the whole). I’ve sat in presentations by private sector companies that think e-learning and computer-based training are synonymous. If you read the magazine “E-learning” there’s loads of adverts in there about how “Content is king” (usually accompanied by a pic of Elvis).

There’s that Oxford Union debate between Diana Laurillard and some private sector representatives about whether e-learning is effective or not, and the majority of it is taken up with talking at cross-purposes about what the word e-learning means. Because if you’ve been working in the field of e-learning in HE for the last 20 years you’ll think that e-learning is about forums, social media, wikis, annotated artefacts, virtual worlds, webinars. The actual content isn’t king, it’s a serf, in the background, called upon when needed, produced when needed, borrowed, shared, but ultimately of little value. That’s where the confusion in the Oxford debate arose. In the private sector there was some backlash against e-learning, with some commentators saying it didn’t work, because people need to be connected, they need tutors and contact with other learners; their definition of e-learning didn’t include those things. In HE learning environments, that’s the heart of what e-learning is. That’s what worries me about those conversations where people are talking about pushing out large amounts of content to people and letting them work through it on their own. It’s a retrograde step.

That’s not to say it never works. I went through an computer-training package last month on data protection. There were bits of videos, some MCQ tests, which were automatically marked, and then you had another chance to have a go if you got them wrong. I learnt quite a bit. So it worked. People have taught themselves by reading books, watching TV shows, working through MOOCs, but these are limited in subject matter, and/or limited to particularly special types of learners who can learn like that. But some stuff needs to be talked about to be understood, some stuff isn’t about being understood, but about being able to work with the ambiguity, some people just need the extrinsic motivation of being part of a learning set to get there. So we need two terms really for e-learning environments. One which is just content, and self-paced and about large numbers of students just learning facts. The other which is still about tutor-student, student-student interactions, and is participative and experiential and enables contextual and applicable information. We could differentiate them with qualifying adjectives, let’s call them crap e-learning and potentially good e-learning. Let’s hope that with the buzz around MOOCs kicking off the pound signs in the eyes of senior managers the one doesn’t get conflated with the other..

AMORES project – the first deliverable


One of the projects I’m working on is the AMORES project, headed by CARNet in Croatia, and funded by the Comenius programme http://www.amores-project.eu/. The aim of the project is “Discovering a love for literature through digital collaboration and creativity” a phrase that took us a long time to develop, but time well-spent as this focuses our attention on the key goals of the project – yes we’re hoping to promote literacy and reading, but the actual aim is generating a love for literature, if literacy improves as a consequence, then great. The means by which we’re hoping to do this is by creating learning activities in which schoolchildren in five different European countries (Denmark, Croatia, Poland, Sweden and the UK) create digital artefacts, mainly videos, and share these with each other.

The first task in the project fell to me, which was to look at the work that had been done in this area before the project started, and also gather together the experience of the contributing practitioners. The report covered the theoretical bases of the work (constructionism, storytelling and experiential learning, looking at previous similar projects) – a key one for us was the Sheherazade project http://www.sheherazade.eu/sites/default/files/deliverable/d3/deliverable3_EN.pdf – and also tried to identify where some of the problematic areas in what we were trying to achieve might lie. The full paper can be read from here http://www.amores-project.eu/results.html (you’ll need to register first, though).

Putting together the report was an interesting process, and it went through many revisions (thanks here should go to the people who read through it, commented and provided additional information – they are Vedrana Vojković Estatiev, Gordana Jugo, Tina Richardson and Geoff Walton). There’s too much in there to cover in a single blog post, so below I’m just going to pick out a few key things.

1)       There’s no consensus on what constructivism or constructionism mean.
Moving from the physical sciences to the humanities as academic disciplines over my career hasn’t been that difficult, apart from in one aspect, the ambiguity around terms. In physics, people might disagree about – say – how many dimensions there are, but they use the same terminology to have that argument in. In educational theory constructivism is variously defined as learning by building things, as learning by building knowledge, learning by building on knowledge, and so on. And the word constructionism is often used interchangeably with these. I don’t find this very helpful, so have tried to impose a set of definitions that disambiguate the terms (although looking over my paper now I realise I’ve used constructionism at one point where I meant constructivism, which doesn’t help either).

I’ve picked constructionism as a term to describe what we’re doing, because well Papert. Since he wrote a lot of the early theoretical stuff on this I’ve gone to him. I like his definition of constructionism because it encompasses a lot of the concepts of constructivism, but divides them into two main aspects. I find taxonomies make things easier to get your head around, although there’s a danger in mistaking the map for reality. The two main aspects of making things are that learning happens because of the creation of an artefact (which is some people’s definitions of constructivism) but also the creation of the artefact involves a social collaborative activity (which is defined by some as social constructivism. Therefore by cherry-picking various definitions we can come up with a clearer definition of what we’re doing i.e. constructionism = constructivism + social constructivism. I’ve used the specifics of actually making things as the basis for our terminology because the more general idea that the learner builds up their knowledge through adding ideas together is pretty much captured by the phrase cognitivism. But from now on, can we all agree to pick one word to mean one thing?

2)       Constructivism has had an upgrade
I like the idea of making stuff and learning by actually having physical things, because I’ve seen it happen in virtual worlds. OK I’m stretching the meaning of the word “physical” but you know what I mean. By actually coming together to build something that has an external reality people develop a shared understanding of what they’re working on, and see each other’s perspectives. There’s also a whole lot of science about embodied cognition, that holding and shaping things works directly on the brain. That’s what we’re trying to do in AMORES (other reasons below). However, one thing I came across in the reading for this, which I think is worth passing on, is that THE VERSION OF BLOOM’S TAXONOMY YOU ARE USING IS OUT-DATED). Well if you’re using the one I learnt, it’s outdated. There’s one put together by Krathwohl in 2002 which places creating at the top of the hierarchy, i.e. it involves all the other stages to get to it (these are Remembering, Understanding, Applying, Analysing, Evaluating by the way). If you find using Bloom’s terms helpful, you might want to read the paper. Andrew Churches in 2008 came up with terms drawn from digital technologies, just to bring them really up to date.

3)       Face-to-face co-creation is plentiful, online co-creation is rare
People use a lot of social media, but despite this, they rarely use social media to actually replicate online the social dimension of co-creation that Papert describes. People tend to upload stuff, and go as far as liking or commenting on it, but the incidences of actually sharing and mixing artefacts in an educational context are rare. It’s another part of the myth of the digital native. There’s some interesting studies (Scardamalia, 2004 and Colasante, 2010) using annotation tools to generate “artefact-centred” discussions, but these don’t happen in mainstream education at all. Although we found some great papers on the role of creating artefacts in education (video is very popular, take a look at Allam (2007) for example, I still have boxes of the proceedings in the attic if anyone’s interested). Furthermore, when we looked at the experience of the schools involved, they’ve all got experience of creating videos in the classrooms, but none had really used social media in their education. Indeed, one or two were very reticent about the whole idea, I think a reaction to how it’s been demonised by the educational establishment in their countries. In identifying which areas of the project are at risk, this one stands out – not only is there not a background of online content creation, and the social learning that can triggered by content creation, in the literature as a whole, using social media to support learning is not something the schools really do.

4)       Experiential learning and storytelling are very similar
Learning is always more effective when it’s reflected upon. We’ve all seen this (you might know it, but do you know that you know it?) Reflection is also an opportunity for students to learn metacognitive skills (how do you learn what you need to learn). For these reasons scaffolding the creation of artefacts and the social aspects of creation into an experiential learning cycle provides a chance to make the whole greater than the sum of the parts. That would be a given in a set of learning activities. However, reading through the Sheherazade report I came across Dahlsveen’s model of storytelling. I can’t reproduce it here (no rights to it), but you can check it out in the original report. It shows the stages that a story goes through from shared creation, to performance, to reaction to revision. This is (according to Dahlsveen and I’d have to agree from my own experience) is what makes storytelling such an engaging and motivating experience. What struck me is if you take her model and bring it round into a cycle, it looks like Kolb’s learning cycle (which is itself based on Lewin’s idea of an engineering feedback loop). Here’s a picture of Lewin’s experiential learning cycle and Dahlsveen’s storytelling model as a cycle:


cycles in sync

So ideally we could scaffold the students’ experience of storytelling so that it could become an experiential learning experience at the same time as being a motivating, engaging and most importantly fun experience for the children. However, if the performance and audience feedback is also going to take place online, then we’re stuck in the same impasse of needing to support the social interactions through social media. It’ll be something to aim for, and exciting to see, but I think this is one area where we will need to place a lot of resources and evaluate what we’re doing very carefully.

Allam, C. (2007) “Using filmmaking to teach students about Shakespeare, urban regeneration and other stuff” in Childs, M., Cuttle, M. and Riley, K. (eds.) DIVERSE Conference Proceedings 2005 & 2006, Glasgow: Glasgow Caledonian University

Churches, A. (2008) Bloom’s Taxonomy Blooms Digitally, Tech & Learning, 4th Jan, 2008 http://www.techlearning.com/studies-in-ed-tech/0020/blooms-taxonomy-blooms-digitally/44988

Colasante, M. (2010) “Future-focused learning via online anchored discussion, connecting learners with digital artefacts, other learners, and teachers”, Proceedings ascilite Sydney 2010, 211 – 221

Krathwohl, D.R. (2002) A Revision of Bloom’s Taxonomy: An Overview, Theory into Practice, Volume 41, Number 4, Autumn 2002,

Scardamalia, M. (2004). CSILE/Knowledge Forum®. In Education and technology: An encyclopedia (183-192)

Sheherezade Consortium (2011) Sheherazade, 1001 stories for adult learning Theoretical background for methodology: summary, http://www.sheherazade.eu/sites/default/files/deliverable/d3/deliverable3_EN.pdf

Post-digitalism – an evolutionary perspective

In June 2009 the ‘52group’ gathered from across the Higher Education sector to consider the confluence of education and the digital. The result was a position paper entitled ‘Preparing for the postdigital era’. At the time the paper was largely met with a mixture of scepticism and confusion, a common response being “The digital hasn’t been superseded?”. Despite this, over the intervening years the term has slowly gained traction in educational contexts.

To what extent our original paper influenced the recent proliferation of the term is of course not clear but we see the concept being employed in various locations including last year’s SEDA conference: “Opportunities and challenges for academic development in a post-digital age” and a forthcoming conference hosted by Greenwich university: Flipping the Institution: Higher Education in the Post Digital Age. There are also numerous examples of the term casually making its way into strategic rhetoric in and around our institutions.

To mark the shift from Digital to Post-digital thinking members of the original ‘52group’ have each revisited the term to consider its definition and relevance five years on. This is my perspective::

Reviewing the Post-digital – five years on

When we were coming up with the idea of the “post-digital” back in 2009 the phrase that seemed to sum up the concept for me was “disappearing into use” – a phrase I heard once and have not been able to remember who to attribute it to. One quote I do know the source of is “Technology is a word that describes something that doesn’t work yet” – which is of course Douglas Adams. There’s McLuhan’s idea (which is covered in Sherry Turkle’s excellent “Life on the Screen”) that when tools become incorporated into our sense of who we are so much that they’re part of our bodies they are more like prostheses than tools. Evolutionarily, technology created the species homo sapiens as much as the other way round. Then there’s Stelarc who gave me a great quote for my last book: “humans are kind of a chimera of meat, metal and code”. If that’s true then technology continues to drive our evolution as a species.

Five years ago I was heavily immersed in virtual worlds. I’d just started finished collecting the data for my PhD about learning in virtual worlds. I was part of a community of academics within Second Life, all of whom I’d met there, very few I’d met in the physical world. I think I saw postdigitalism as the blurring of the lines between the physical and virtual, led largely by the development of Augmented Reality as a way to map the digital directly on to the physical. Many of us would spend our lives switching between the two, or having both simultaneously. I wasn’t the only one; Gartner (those of the hype cycle) predicted that 80 percent of active Internet users (and Fortune 500 enterprises) would have an avatar in a virtual world by the end of 2011. I had the idea that the change we’d all have to go through was to learn to blend the two, which I summarised in the phrase “mutatis metaxis mutandis”. Unsurprisingly, the phrase didn’t catch on. But neither did the technology.

We’ve passed that date and Google has just ended its Google Glass development; news reports are decrying it as a failure. No-one seem to have picked up on the value of AR overlaying information but have instead focused on the creepiness of surreptitious recording, and how nerdy Glassholes look. Many of the people I knew through SL are now gardeners, farmers, silversmiths, vicars, or working in international development. It’s not dead, but it’s not exactly thriving either. On the other hand, at every social occasion everyone gets their phone out immediately anything vaguely interesting happens, takes a photo then immediately uploads it to Facebook. They then check repeatedly on what comments have appeared and how many people have liked it. In that way at least the online digital space pervades our lives ubiquitously. On the technology –> tool –> prosthesis continuum, phones are a long way along the process becoming our physical extensions.

So I would say that the idea of the post-digital, that technology just becomes incorporated into our lives so much that we don’t notice it, is still an interesting process to look out for, and still has relevance as a term. It’s the point at which technology really starts to work, and so is unnoticeable, is when it really starts to matter to us. There are one or two technologies we can point to and say, “that’s invisible to us”, but that general transformation, to a postdigital society, or to postdigital humans, where technology truly becomes integral to us, now seems further away to me than it did five years ago.

Further reflections on the Post-digital from members of the 52group:

Dave Cormier:  http://davecormier.com/edblog/2015/02/05/looking-back-at-postdigital-6-years-later

Richard Hall: http://www.richard-hall.org/2015/02/05/reflections-on-the-post-digital

Lawrie Phipps: http://lawrie.jiscinvolve.org/wp/2015/02/04/pd_review/

David White: http://daveowhite.com/post-digital-revisited/