I’m Not A Programmer But Programming Skills Are Still Extremely Useful

I don't work in IT, software development, or anything even closely related to those fields so I'm often surprised at how much programming I do in my daily work life.  At times I write scripts or light programs (e.g., this set of Excel macros), usually to save time and ensure accurate, well-documented, and reproducible results.  More often, I directly use some of the skills of programming, especially flow control and abstraction, to make tasks easier, elegant, or possible.

When I first entered college in 1996, I began as a computer science major.  After a few years I changed my major because I was dissatisfied with the amount and kind of programming I was doing.  I've never looked back and I've never pined for my missed life of code slinging. I have some sympathy for movements that purport to teach programming to anyone who is interested but I don't believe that programming is an essential skill for every person in the 21st century anymore than metal fabrication was an essential skill for every person in the 20th century.

A few concrete examples may be helpful.  First, I spend quite a bit of my time analyzing quantitative data e.g., student grades and assessment data, student retention data, and survey responses.  I usually do that analysis (and much of the pre-analysis work such as data cleanup, creation of new variables, aggregating and matching of different data sets) using SPSS, a statistical analysis program commonly used in the social sciences. Although SPSS can be operated almost entirely using point-and-click menus, my real work is done using the program's programming language (called "syntax" although it's really just a scripting language).  This makes my processes (a) self-documenting and (b) replicable.  In other words, by using and saving SPSS syntax in organized ways I always know exactly what I did and I can easily make changes or corrections.

Second, I seem to use programming logic quite often when working with larger surveys. I've become quite good using some of the more advanced features of Qualtrics, the online survey tool for which we have a site license. I declare variables and pass them around between surveys and reports using Qualtrics's "embedded data" feature.  I also use some of the different features of the tool that allow me to divide a given survey into different sections and selectively display only those sections that are relevant to a particular respondent.  Combining these features is allowing us to move a key assessment process for one of our academic departments from a cumbersome series of Excel spreadsheets and Word documents that is entirely manual to a Web-based process that still requires some manual data entry but has some built-in checks for data quality and reporting tools that are largely automated.

I'm not advocating that everyone must learn how to program.  I am advocating that those who regularly work with quantitative data – assessment folks, researchers, evaluators, analysts – learn some basic programming skills including flow control, abstraction, and uses of variables.  I spent part of my life trying to actively avoid programming and I've moved completely out of IT but programming skills have proven to be extremely valuable, useful, and sometimes essential.

The Psuedo-curriculum

I know this will be provocative for some of you but lately when I've heard people use the phrase "co-curriculum" I've silently translated it in my head to "psuedo-curriculum." I'll explain more below but understand that I am not devaluing out-of-class activities but expressing frustration that we don't really value them.

My frustration here has been long simmering but two strands of experience and thought are mingling and bringing things into focus for me.

First, I'm teaching another graduate course in pedagogy this semester. Last semester we focused on smaller details of teaching and learning largely by examining teaching methods (e.g., problem-based teaching, service learning, team-based learning) and lesson plans using the Decoding the Disciplines approach. This semester, we're focusing on larger details of teaching and learning using a problem-based learning approach to build a course using backward design and the principles in How Learning Works: Seven Research-Based Principles for Smart Teaching. Specifically, my students are building a first-year experience course. (I chose that as the central problem because it's one of the few courses that cuts across all disciplines so everyone could work on the same thing.  I've taken and taught similar classes in the past where students each created their own course specific to their discipline and I want to see if this pedagogy course turns out any better if I have everyone creating and working on the same kind of course.)

Although our pedagogy classes have traditionally been aimed at graduate students, my colleagues and I have made a concerted effort to open them up to post-docs, university administrators, and others who have the interest and drive to fully participate throughout the entire semester.  This semester, I reached out to my colleagues in residence life and two of their staff are in this class.  The course is still primarily geared toward graduate students who will pursue tenure-track positions but the ideas and principles are widely applicable to human learning and teaching which of course is the aim of the co-curriculum, too.

Of course, my residence life students have brought unique views and ideas to the course.  Among those views are reoccurring ones that they (a) don't have enough time with students for them to master – be introduced to, practice many times, and receive feedback about – skills and knowledge (as compared to courses that meet several times a week for several hours during a semester or degree programs that span many courses over many semesters) and (b) students don't value or understand the skills and knowledge they should be acquiring and practicing in the residence hall co-curriculum.  Those are legitimate points and I understand and share their frustration.

Second, general education reform is in the air at my university. There are plans and rumors, some of which have a very firm basis in reality, that we're about to make a serious run at updating, changing, or otherwise tackle general education.  Some of this is probably motivated by issues that we'll have to address next year when we write our Periodic Review Report, the document we write midway between each of our regional accreditation reviews that occur at ten-year intervals.  Some of it is probably motivated by our provost who is relatively new but has been here long enough to begin to build and carry out his agenda.  In any case, it's got me thinking a lot about our general education requirements and the other things that we require students to successfully complete before we award them a degree.

Here is where these two strands of thought coalesce: If the so-called co-curriculum were really as highly valued as the curriculum, students would (a) have to successfully complete – with measurable goals and evidence that they've attained them – co-curricular requirements and (b) be able to meet graduation requirements such as general education requirements not only through coursework but also through rigorous co-curricular activities.  In other words, if we valued the co-curriculum then it would genuinely stand alongside the curriculum and be part of the credentialing process that is modern higher education.

Yes, that does happen to some degree even at my university.  Most first-year students are required to live on campus and all first-year students are required to complete a First-Year Experience Seminar, a one-credit pass/fail course.  But I imagine that like many colleges and universities that require students to live on campus that the requirement is driven as much by financial reasons (we have huge bills to pay with those large buildings!) as by educational ones.  And I can't really argue that our FYS course is part of the co-curriculum since the vast majority of those courses are taught by faculty especially for the 60% of students who take specialized FYS courses offered within their major department and taught by their major faculty, often for 2-3 credits instead of the 1 credit of the "default" FYS course.

There may be other ways that the co-curriculum is genuinely valued at my university and I'm simply unaware of them.  I know that some other institutions have parts of the co-curriculum strongly integrated into their graduate requirements.  For example, a few universities such as Drexel and Northwestern have integrated cooperative education into their undergraduate experience in ways that make me very envious.  Some universities like Stanford have wonderfully advanced systems that allow and encourage students to add co-curricular activities (and artifacts!) to their official transcript.

Until we meaningfully integrate the co-corriculum into the undergraduate experience by (a) requiring students to measurably master some skills or knowledge through out-of-class activities or allowing students to meet existing requirements (i.e., general education requirements) through successful completion of rigorous out-of-class activities and (b) including those activities on transcripts and in degree audits, I will continue to mentally translate "co-curriculum" to "pseudo-curriculum" in my head.  Unless we meaningfully substatiate those activities by holding those who participate in them accountable for meeting genuine, realistic educational goals those activities will remain a false curriculum subordinate to the real one that we value with recognized metrics and credentials.

Essential Reading for Technology in Student Affairs v1.1

A few weeks ago, I posted a set of recommended readings that I originally sent to a colleague who asked me what I would recommend as essential reading for understanding technology in student affairs.  I’ve updated this list adding two sets of resources.  First, I included danah boyd’s new book It’s Complicated: The Social Lives of Networked Teens now that (a) I have read it and (b) it’s available for purchase and download (for free!).  It supersedes her 2008 book chapter “Why Youth (Heart) MySpace: The Role of Networked Publics in Teenage Social Life” in Youth, Identity, and Digital Media.  It covers many of the topics mentioned in this list and the introduction alone is a good summary of many of these issues.  Second, I added a mention of Eszter Hargittai’s work on Internet use and social inequality.  It’s a good addition and an oversight on my part to not have included something substantive on this topic in the original list.


If we limit the list of essential student affairs technology articles to those written by student affairs scholars or professionals, published in student affairs journals or books, or about student affairs then I’m hard pressed to name an article that I consider essential.  There have been some good articles, books, and chapters that are important in particular, narrow contexts but I don’t think that I’ve seen anything essential or seminal.  The articles in these categories tend to be too narrow in scope either because they focus too narrowly on a contemporary issue or technology (and thus quickly fall out-of-date) or because they neglect much or all of the scholarship that lies outside of higher education and student affairs.

If we go outside of student affairs and higher education to consider literature produced in other disciplines then we have to be ruthless in culling the list to a manageable size.  Maybe we can do that by trying to list some of the big ideas and an accessible entry point or summary of each idea.

  1. Historical origins of the information age: I think it’s important to ground our understanding of technology by beginning…well, in the beginning.  This is especially true because many people think that technology or the study of technology is new, perhaps beginning with the microcomputer explosion of the early 80s or the development of the World Wide Web in the early 90s.  Much of the work in defining and exploring the information age has been done by economists who place the beginning of the information age in the early 20th century before computers even hit the scene.  Daniel Bell’s 1973 book The Coming of Post-Industrial Society is a classic example of this work.  However, I’d probably lean toward Kenneth Galbraith’s 1972 (2nd ed.) The New Industrial State because it’s also a seminal work and I think that everyone should read something written by Galbraith at least once in their life.  This book also changed my entire view of committee work which was very unexpected but very pleasurable.
  2. Technological utopia/dystopia: Many people, including scholars who should know better, write and think about technology in simplistic terms such as utopian (e.g., Friedman and the rest of the uncritical MOOC cheerleaders) or dystopian views.  Rob Kling was a powerful voice in this conversation and his 1994 article “Reading ‘All About’ Computerization: How Genre Conventions Shape Non-Fiction Social Analysis” in The Information Society 10(3) is a classic article on this topic.
  3. Technological determinism: Another popular but problematic way that many people think and write about technology is to embrace “technological determinism,” the idea that technology is such a powerful force that it plays the central role in social and cultural development; a weaker formulation is that we can readily predict and understand how technology is used and developed based only on the properties of that technology. John Seely Brown and Paul Duguid’s 2002 instant-classic The Social Life of Information is a wonderful book that expertly addresses this well-debunked-but-still-prevalent idea.  Claude Fischer‘s 1992 book America Calling: A Social History of the Telephone to 1940 is another fantastic and enjoyable book in this vein although it is more narrow in scope with its focus on some of the origins and early uses of telephones in the U.S.  (I also enjoy Fischer’s book because of the clarity with which he describes his research methods and limitations.)
  4. Computer-mediated communication (CMC): Much of the time when we are thinking about technology we are really focusing on a much more narrow use of some specific technologies and using computers to communicate with others is perhaps the most prevalent focus for people in the student affairs profession.  This is a large and rapidly growing body of research with many summaries and literature reviews.  Although it’s a bit old, I would suggest Susan Herring‘s 2002 Annual Review of Information Science and Technology article “Computer-Mediated Communication on the Internet.”  She touches on many different aspects of CMC and does so with a deep understanding of its history and social implications.
  5. Youths’ use of CMC: Although the majority of students enrolled in U.S. colleges and universities are 22 years old or older, many student affairs professionals still focus primarily or exclusively on younger students.  There has been an explosion of research in this area in the last decade especially concentrated on youths’ use of social media e.g., Facebook, MySpace.  danah boyd‘s 2014 book It’s Complicated: The Social Lives of Networked Teens is a must-read in this area; it’s available for download for free (but please consider purchasing a copy – it’s worth it!).  The 2010 book Hanging Out, Messing Around, and Geeking Out: Kids Living and Learning with New Media covers similar ground and has been critical in informing and forming some of my thinking on this topic. This book is also methodologically impressive as a large collaboration between a large group of ethnographers who tried to synthesize their different-but-complementary studies.
  6. Technology in U.S. higher education: Offhand, I can’t think of any really good, time-tested, and expansive articles or books about technology in U.S. higher education.  Perhaps the most commonly cited work is Chickering and Ehrmann’s 1996 article “Implementing the Seven Principles: Technology as Lever.”  It’s a followup to the classic 1987 Chickering and Gamson article (“Seven Principles for Good Practice in Undergraduate Education“) in the same publication.
  7. Contemporary sources of information: I regularly keep up on technology ownership, access, and use in the U.S. by reading the reports produced by the Pew Internet & American Life Project.  Serving the same purpose but in the more narrow niche of U.S. higher education are the materials produced by EDUCAUSE, especially their annual survey of students and information technology and their public summaries of information collected in their Core Data Service.
  8. Disappointing but unavoidable assumptions: I’m sure you’re already familiar with all of the problematic assumptions and stereotypes of the “Millennial Generation” that play a disappointingly strong role in many of our assumptions about younger students’ use of technology.  On the same note, it’s also worth revisiting Marc Prensky’s original 2001 Digital Natives, Digital Immigrants article as that discourse is still prevalent today.  Eszter Hargittai at Northwestern University has done quite a bit of work in the area of Internet use and social inequality; her 2010 article “Digital Na(t)ives? Variation in Internet Skills and Use among Members of the ‘Net Generation’” in Sociological Inquiry is a good overview of some of this work.

Essential Reading for Technology in Student Affairs

Last week, a colleague asked me what I would recommend as essential reading for understanding technology in student affairs.  Others may also be interested in this topic so this is what I told him (with a few minor edits):


If we limit the list of essential student affairs technology articles to those written by student affairs scholars or professionals, published in student affairs journals or books, or about student affairs then I’m hard pressed to name an article that I consider essential.  There have been some good articles, books, and chapters that are important in particular, narrow contexts but I don’t think that I’ve seen anything essential or seminal.  The articles in these categories tend to be too narrow in scope either because they focus too narrowly on a contemporary issue or technology (and thus quickly fall out-of-date) or because they neglect much or all of the scholarship that lies outside of higher education and student affairs.

If we go outside of student affairs and higher education to consider literature produced in other disciplines then we have to be ruthless in culling the list to a manageable size.  Maybe we can do that by trying to list some of the big ideas and an accessible entry point or summary of each idea.

  1. Historical origins of the information age: I think it’s important to ground our understanding of technology by beginning…well, in the beginning.  This is especially true because many people think that technology or the study of technology is new, perhaps beginning with the microcomputer explosion of the early 80s or the development of the World Wide Web in the early 90s.  Much of the work in defining and exploring the information age has been done by economists who place the beginning of the information age in the early 20th century before computers even hit the scene.  Daniel Bell’s 1973 book The Coming of Post-Industrial Society is a classic example of this work.  However, I’d probably lean toward Kenneth Galbraith’s 1972 (2nd ed.) The New Industrial State because it’s also a seminal work and I think that everyone should read something written by Galbraith at least once in their life.  This book also changed my entire view of committee work which was very unexpected but very pleasurable.
  2. Technological utopia/dystopia: Many people, including scholars who should know better, write and think about technology in simplistic terms such as utopian (e.g., Friedman and the rest of the uncritical MOOC cheerleaders) or dystopian views.  Rob Kling was a powerful voice in this conversation and his 1994 article “Reading ‘All About’ Computerization: How Genre Conventions Shape Non-Fiction Social Analysis” in The Information Society 10(3) is a classic article on this topic.
  3. Technological determinism: Another popular but problematic way that many people think and write about technology is to embrace “technological determinism,” the idea that technology is such a powerful force that it plays the central role in social and cultural development; a weaker formulation is that we can readily predict and understand how technology is used and developed based only on the properties of that technology. John Seely Brown and Paul Duguid’s 2002 instant-classic The Social Life of Information is a wonderful book that expertly addresses this well-debunked-but-still-prevalent idea.  Claude Fischer‘s 1992 book America Calling: A Social History of the Telephone to 1940 is another fantastic and enjoyable book in this vein although it is more narrow in scope with its focus on some of the origins and early uses of telephones in the U.S.  (I also enjoy Fischer’s book because of the clarity with which he describes his research methods and limitations.)
  4. Computer-mediated communication (CMC): Much of the time when we are thinking about technology we are really focusing on a much more narrow use of some specific technologies and using computers to communicate with others is perhaps the most prevalent focus for people in the student affairs profession.  This is a large and rapidly growing body of research with many summaries and literature reviews.  Although it’s a bit old, I would suggest Susan Herring‘s 2002 Annual Review of Information Science and Technology article “Computer-Mediated Communication on the Internet.”  She touches on many different aspects of CMC and does so with a deep understanding of its history and social implications.
  5. Youths’ use of CMC: Although the majority of students enrolled in U.S. colleges and universities are 22 years old or older, many student affairs professionals still focus primarily or exclusively on younger students.  There has been an explosion of research in this area in the last decade especially concentrated on youths’ use of social media e.g., Facebook, MySpace.  danah boyd‘s 2008 book chapter “Why Youth (Heart) MySpace: The Role of Networked Publics in Teenage Social Life” in Youth, Identity, and Digital Media is a must-read in this area.  The 2010 book Hanging Out, Messing Around, and Geeking Out: Kids Living and Learning with New Media covers similar ground and has been critical in informing and forming some of my thinking on this topic. This book is also methodologically impressive as a large collaboration between a large group of ethnographers who tried to synthesize their different-but-complementary studies.
  6. Technology in U.S. higher education: Offhand, I can’t think of any really good, time-tested, and expansive articles or books about technology in U.S. higher education.  Perhaps the most commonly cited work is Chickering and Ehrmann’s 1996 article “Implementing the Seven Principles: Technology as Lever.”  It’s a followup to the classic 1987 Chickering and Gamson article (“Seven Principles for Good Practice in Undergraduate Education“) in the same publication.
  7. Contemporary sources of information: I regularly keep up on technology ownership, access, and use in the U.S. by reading the reports produced by the Pew Internet & American Life Project.  Serving the same purpose but in the more narrow niche of U.S. higher education are the materials produced by EDUCAUSE, especially their annual survey of students and information technology and their public summaries of information collected in their Core Data Service.
  8. Disappointing but unavoidable assumptions: I’m sure you’re already familiar with all of the problematic assumptions and stereotypes of the “Millennial Generation” that play a disappointingly strong role in many of our assumptions about younger students’ use of technology.  On the same note, it’s also worth revisiting Marc Prensky’s original 2001 Digital Natives, Digital Immigrants article as that discourse is still prevalent today.

They Said it Better Than I Can

I’m a bit ashamed and embarrassed that I haven’t written anything here in so long!  The fall semester was very, very busy but one reason why I haven’t written anything is that there are so many eloquent, informed people who have written things that I want to say much better than I could have done so.  Here are some of the blogs that I follow that regularly impress me:

  • e-Literate: Led by Michael Feldstein, this group of authors routinely post insightful and detailed information about technology and U.S. higher education e.g., What Faculty Should Know About Adaptive Learning, State of the Anglosphere’s Higher Education LMS Market: 2013 Edition.  Some of their posts are a little bit hyperbolic and occasionally shrill (presumably to attract more readers), particularly this post.  Despite the occasional over-the-top writing, this blog was an excellent source of information about the recent kerfuffle about Purdue University’s learning analytics software.
  • Culture Digitally: This is another group blog, one that describes itself as “a gathering point around which scholars who study of cultural production and information technologies can think together.”  This blog doesn’t focus on higher education but it has posts from some wonderful researchers on the cutting edge of culture and technology.  I particularly like this recent post discussing “big data” and its potential shortcomings.
  • The Young and the Digital: This website is a companion to S. Craig Watson’s 2010 book of the same name.  It’s a great book and it’s very nice to be able follow the author as he continues to develop and share his thoughts.  This post is a great example of the good thoughts that are shared on this website.
  • Microsoft Social Media Collective Research Blog: The title of this blog tells you almost all you need to know.  This is a group of exceptional researchers who appear to have significant freedom to conduct ethical research without being unduly influenced by their employer.  This post listing some researchers’ opinion of the most influential journal article has a year’s worth of reading for anyone interested in social media.
  • Josie Ahlquist’s blog: A colleague – Joe Sabado, who has a nice blog of his own! – recently turned me on to Josie’s website.  She’s an EdD student who is beginning a dissertation focusing on “social media communication tools in higher education, focusing on college student use and educational methods to equip students to be positive productive citizens on emerging technologies.”  She is very well-informed and is doing a wonderful job of sharing and synthesizing the information she is discovering as she is completing her literature review. I’m very excited to follow her as she begins her research!

The Faculty Development Metagame

One of the things I most enjoy about faculty development – consulting with faculty about their teaching and professional development – is what I have begun to think of as the “faculty development metagame.”  It’s not really a game but it’s so enjoyable that I’m reluctant to give up the word for one that is, strictly speaking, more accurate.

The metagame goes like this: In my interactions with faculty, particularly more formal and planned ones such as workshops, I usually have to find ways to explicitly model and use whatever I am discussing or presenting to form the basis of the interaction itself.  In the broadest sense, that means that I can’t continue to champion “active learning,” “student engagement,” and other ideas that are built on the idea that people learn best when they practice and receive feedback if I don’t actively model and practice those ideas myself.  In other words, I can’t tell faculty that lectures are usually a terrible way to teach students by lecturing those faculty.

In a more specific sense, this means trying to find ways to model and use the specific techniques, tools, or whatever is the topic of discussion as the framework for the interaction. The topic of discussion is used to create the discussion itself e.g., a discussion about collaborative tools takes place using tools such as Google Docs and Twitter, a workshop about flipping the classroom requires participants to have watched videos and done other preliminary work prior to the workshop (and of course some will not have done so so they – like students in their classroom – will have to figure out what to do about the group members who aren’t prepared!).  Of course, that means that the interaction will contain little actual discussion in the form of me lecturing and quite a bit of activity both on my part and on the part of the faculty with whom I am working.

I believe this metagame is necessary for at least three reasons:

  • Authenticity: My credibility is injured when I put forth ideas about teaching and learning that I do not myself practice or believe.
  • Efficiency: I am more efficient when I can save time by introducing and demonstrating something at the same time.  If I can get others involved at the same time then that’s even more time saved!
  • Effectiveness: I genuinely believe in the ideas, techniques, and tools that I try to pass along to my faculty.  Just as I believe that they will be more effective teaching their students if they use them, I believe that I am more effective teaching faculty if I use them, too.

Just as importantly, this metagame also makes faculty development very challenging and very fun!  It’s often difficult to figure out ways to employ the techniques and tools being presented in a particular consultation as the consultation itself, especially in ways that are genuine and not facile. Figuring out to meet that challenge makes my job much more interesting and fun.

Often it’s obvious when I’m modeling something and using it as the basis of a consultation or workshop.  But every once in a while I get to have a fun little moment at the end of the interaction where I tell my colleagues: “And that cool thing we’ve been talking about for the past hour? We’ve been doing it!” That makes it even more fun.

A brief example may be helpful: This fall I’ll be teaching a pedagogy class for graduate students and one specific technique they’ll learn is a technique called a “concept lesson.”  Two of the key elements of a concept lesson are a solid metaphor – not an example – for the idea on which you’re focusing and an actual example.  I will, of course, use a concept lesson to teach about concept lessons so I will need an appropriate metaphor and example.  I will teach a concept lesson about concept lessons; that is the metagame.

It’s not always possible to do play the metagame.  There are some tools or techniques that simply take too much time to play out or are so situation- or discipline-specific that they can’t be realistically employed in an artificial setting.  That can make them a tough sell and that’s when it’s incredibly helpful to have (a) others who have experience with it to provide examples and testimony, (b) video, or (c) other artifacts that make the idea real and concrete instead of just an abstract discussion.

 

Self-regulated Learning and Age in a Hybrid Course

Earlier this spring, I worked with a wonderful faculty member to conduct research into a new hybrid version of an introductory Spanish course at our university.  He changed some sections of a 4-credit course that typically meets four days each week to so that they only met two days each week with a substantial increase in online activity.  I presented a paper on this research at the recent AIR conference with the basic questions: (a) Did students learn more or less in these hybrid sections? and (b) Did students who were more motivated or exhibited better study skills – measured using the Motivated Strategies for Learning Questionnaire (MSLQ) – learn more?

The full details are in the paper but it appears that the answers to our questions are:

  1. Students didn’t learn any more or less in the hybrid sections.  This is consistent with the larger body of research that has found “no significant difference” between courses taught using different media.  In fact, this is good news in some ways since we can implement more hybrid sections and courses with some confidence that student learning won’t be negatively impacted.  This is particularly beneficial for us as these small four-credit courses require a lot of classroom space.
  2. The impact of self-regulated learning is unclear.  Of the three outcome measures included in this study, performance on the MSLQ was only partially related to two outcomes.  This is contrary to our expectations as it seems reasonable that students who are motivated and use better study skills would learn more.

To me, the most interesting part of this study is the role of age in predicting student learning. We created several multiple regression models and age was a negative predictor of student grades but a positive predictor of improved proficiency in reading Spanish. In other words, after we accounted for things such as race/ethnicity and gender, older students tended to earn lower grades but they also seemed to learn more about reading Spanish (but not about listening to Spanish).  So older students have learned how to study more effectively and are more motivated to learn, right?  No, at least not according to the MSLQ results: Age was not significantly correlated with the MSLQ results.

In addition to the quantitative measures used in this study, we also interviewed several students.  At the same time, we also repeatedly interviewed students in some math courses that were also being modified – “flipped” – during the same semester.  We were consistently impressed with the older students in our interview sessions and very much enjoyed their maturity and self-reflection.  That suggests an interesting hypotheses: Were the older students in this study were simply less concerned with grades and more concerned about learning?

Student Engagement Infographic

Infographic of University of Delaware senior student participation in selected high-impact practices from NSSE 2011

Infographic of University of Delaware senior student participation in selected high-impact practices from NSSE 2011. This image links to the full-size graphic.

Last week, my colleagues and I presented the final UD First Friday Roundtable on Teaching of this semester.  We focused on “student engagement,” specifically naming the session “What Does an Engaged UD Student Look Like?”  It was a good session with lots of great discussion but right now I want to narrowly and briefly focus on two graphics that we whipped up for our supporting materials.

The first image in which you might be interested is a simple infographic showing University of Delaware student participation in some high-impact practices as extrapolated from NSSE 2011 responses.  The image to the right shows one part of the entire image to give you an idea what it looks like. This extract from the full-size image links to the a larger version of the full infographic; some of the text is too small to read even in that large image so you can also download the full-size pdf. It worked out quite well as a full-size poster and I also modified it to work as a handout for attendees.  It’s not bad for the amount of time I had to put into it although I would have liked to have done a lot more and a lot better.

For each of the six selected high-impact practices, I included not only the overall percentage of senior students who reported participating in them but also the subgroups for which there were significant (p ≤ .05) differences.  I looked at differences between students of different genders, white and non-white students, students in STEM and non-STEM disciplines, and first-generation and non-first-generation students.  If I had more time, I would have loved to have created another set of graphics illustrating the impact of these practices or some broader measure of student engagement on self-reported GPA and gains especially if these data showed what the national data tend to show is that these activities or engagement overall sometimes has more impact on different kinds of students.

2013-05-03 Engagement Roundtable word cloud The second image is a simple word cloud we used on some of our materials such as the agenda and signs.  I know that word clouds are passé (or maybe I’m the only one who thinks so) but this was a really simple and quick image for us to create.  Just as important, it was closely tied to the topic of the event as we used the text of one of the primary resources – Kuh’s 2008 AAC&U high-impact practices publication* -  we used to develop and think about the event as the input for the word cloud generated using Tagxedo.

 

* Kuh, G. D. (2008). High-impact educational practices: What they are, who has access to them, and why they matter. Washington, DC: AAC&U.

Are High Impact Practices Available Online?

I am still wrestling with my unease with MOOCs and I think I’ve finally figured out why: High impact educational practices, as we understand them today, are unlikely at best and impossible at worst in MOOCs and other similar online environments.

First, it’s helpful to understand that “high impact practice” (HIP) is a term of art.  Although the phrase is probably very common, in the past ten years or so the term has taken on special significance in U.S. higher education.  Popularized by George Kuh and emerging partly from research using data from the National Survey of Student Engagement (NSSE), this phrase has come to mean a particular set of activities that many higher education researchers believe are especially effective in promoting important and lasting changes in undergraduate students: First-Year Seminars and Experiences, Common Intellectual Experiences (i.e. core curricula), Learning Communities, Writing-Intensive Courses, Collaborative Assignments and Projects, Undergraduate Research, Diversity/Global Learning, Service Learning, Community-Based Learning, Internships, and Capstone Courses and Projects.

Unfortunately, we sometimes place too much focus on these particular activities without understanding why these activities have a high impact.  As originally described by Kuh in 2007, these practices share six characteristics:

  1. HIPs “demand that students devote considerable amounts of time and effort to purposeful tasks (p. 7)”
  2. HIPs place students in circumstances that require they “interact with faculty and peers about substantive matter (p. 7)”
  3. HIPs greatly increase the likelihood that students will interact with people who are different from themselves
  4. HIPs provide students with very frequent – sometimes continuous – feedback from faculty and peers
  5. HIPs require students to operate in intellectually complex ways by connecting knowledge in different courses and applying it in different contexts e.g. confronting complex real-world issues, investigating unfamiliar research problems
  6. HIPs occur in the context of a “coherent, academically challenging curriculum (p. 8)”

I am particularly interested in focusing on these characteristics of high impact practices as I will be helping lead a discussion on my campus next month focused on student engagement.  Most of the participants will be faculty and much of our focus will be on activities that faculty are using or can use in their curricula to promote student engagement.  Given that focus, I don’t think it would be helpful to focus on the specific activities identified as HIPs as those are often beyond the resources and purview of an individual faculty member.  Instead, we will focus on why those activities have a high impact so we can apply those principles to the activities within the power and resources of individual faculty.

That is what was on the forefront of my mind when I “attended” an EDUCAUSE Learning Initiative (ELI) online conference last week that focused on MOOCs.  The conference had some very active discussions among participants and as I participated in those discussions it occurred to me that one of the primary reasons I am uncomfortable with MOOCs is that it is difficult or impossible to apply much of what we know about good teaching in that environment.

Look back up at those six principles of high impact practices.  How do we do apply those principles in a MOOC?  More pointedly, can we apply those principles in a MOOC?  I despair that the answer is mostly “no.”  I pray that it is a simple lack of imagination on my part, a misunderstanding of what we can do in a MOOC, or that this is a fatal flaw of the dominant MOOC model that others will quickly recognize and fix or use to abandon that model.  I also confess that I don’t completely understand all of the discussions about “xMOOCs” and “cMOOCs” on anything but a very theoretical and abstract level and I have a sneaky suspicion that I’m missing something very important in how cMOOCs address some of these principles.

There is another interesting and hopeful way to think about this.  Another ELI conference attendee – I’m sorry that I don’t remember who – suggested that there may be other paradigms of effective educational practices that MOOCs might better fit.  Although I am a little bit skeptical that our understanding of effective education is going to be radically upended, this recommendation to not be too constrained by our current thinking is a very good one.  In fact, that is one important reason why I will be trying to steer our discussion here on my campus next month away from the specific activities and toward the broader principles so we can compare our thinking about student engagement with that of others’.  The idea isn’t to impose the model on my campus but to use it as a common starting point that must be adapted to our unique needs and resources.

That, of course, is what we’ll need to do with MOOCs: Use our best understanding of effective teaching and shape it to this unique environment with unique affordances.  I don’t know how to do that and I don’t know if that is what is being done.  I am wary that much of what is being done is not methodical and not built on what we know about how people learn.  I am especially skeptical that we can provide the kind of demanding and socially and intellectually connected experiences that we know provide some of the best learning.  I hope that people smarter than I are figuring this out, though, and working out how MOOCs can provide high impact educational practices.

Advantages and Challenges of Tech Skills in a Non-Tech Job

Posterboard showing a draft sitemap for part of a new website

The initial planning stages of our new website.

When I was on the job market last year, I was not interested in a job in IT.  Although I’m a little bit rusty in some areas after spending five years in a PhD program, I have the skills and background to work in IT as I’ve done in previous jobs.  But I was interested primarily in faculty development and assessment jobs.  For many of those positions, I deliberately downplayed my technology background because I wanted to be interviewed and hired because for my research and assessment skills.  I seem to have been successful because I’ve found a wonderful research analyst position in a teaching and assessment shop where my none of my job responsibilities involve technology maintenance, development, management, or support.

That has made the last couple of weeks a little bit strange as I’ve taken on significant responsibility in planning and supporting my center’s website as we finish merging our old websites and move them to a new content management system. This is the kind of project I was trying to avoid because it’s completely outside my current job description and I fear being typecast in this role. But you know what? It’s working out just fine. I am able to greatly help my colleagues and they are supportive and grateful but I don’t fear being relegated to being the unit’s tech support.

This is possible because of two things. First, I have wonderful coworkers who are very supportive. They are supportive of my growth as a professional as a higher education scholar, researcher, and faculty developer. They are also very respectful about how my time is used and the kinds of tasks they ask me to take on. Second, I have been very open about setting boundaries. I am always happy to help my colleagues wth technical issues but they are also okay with going through regular channels for larger, more complex issues even though I could spend time solving many of those, too. Because I have been very open with my colleagues about how I would like to use my experiences and knowledge and because my colleagues are wonderful, they have even shielded me a bit to ensure that others don’t try to take advantage of me. For example, despite our official tech support warming up to me very quickly (e.g., it only took a few minutes of me asking the right questions to be granted local admin access to my computer, something that apparently is a rarity here) my colleagues have intentionally made someone else our unit’s official point of contact with tech support to ensure they would not rely on me to solve problems or do extra work.

This seems to be working out well. My background gives me the knowledge to ask many of the right questions when we’re dealing with technology e.g., I can “geek out” with a colleague in IT to more effectively and efficiently probe for information as we figure out which content management system to use for our new website. My skills let me solve little problems in our office very quickly or recognize when problems are out of our control or even unsolvable. My experience guides me to help my colleagues make wise decisions that will be maintainable into the future even when I no longer work here e.g., we’re going to move to Qualtrics as our event registration system instead of using custom-built Google Forms that require significant technical skill to effectively use and maintain.

You can take the computer geek out of IT but apparently you can’t take the IT out of the computer geek. And I’m becoming okay with that.

Where higher education and technology meet