Subscribe to RSS

Mistaken Goal: Where Higher Education & Technology Meet


"...technology is not something that happens to us. It is something we create. We must not confuse a tool with a goal. We must, therefore, be sure that technology serves the fundamental purposes of higher education." Stanley N. Katz in "In Information Technology, Don't Mistake a Tool for a Goal"

Thoughts on Backward Design

 This post will be less organized than most posts; some of these thoughts and ideas are still a little raw.

Backward design – the method by which one begins with the desired end result(s) of an educational program, determines acceptable evidence showing that the result(s) has been achieved, and then creates a plan to teach the skills and content that will lead students to provide that evidence – has been on my mind lately.  It’s one of the core concepts of a college teaching and learning course I co-teach but that’s not why I’ve been thinking about it.

For me, backward design is a “threshold concept;” it’s an idea that changed how I think about teaching and I can’t go back to how I thought prior to this change.  So although I learned and most often use and teach backward design in the context of designing or redesigning a single college course, I’ve been thinking about the role of backward design in different contexts.  For example:

  • I know that backward design has been and is used to develop curricula and not just individual courses.  Today was the first time I got to see firsthand how that plays out with a group of faculty to develop a full 4-year curriculum for this discipline.  I was most struck by how difficult it was to keep true to the backward design philosophy and not get mired down in content coverage and the limitations imposed by the current curriculum.  It was difficult even for me to remain on course as I tried to help facilitate one of the groups of faculty engaged in this process.  I underestimated the increased complexities involved in scaling up the process from a single course to an entire curriculum; it’s not a linear function.
  • There has been quite a bit of discussion lately among student affairs professionals regarding their conference presentations (e.g. this Inside Higher Ed blog post with 30 comments).  Put bluntly, many people are unsatisfied with the current state of these presentations.  Just as backward design can scale up from a class to a curriculum, it can also scale down to a single class session.  And shouldn’t a good 50 minute conference presentation resemble a good 50 minute class session?  So why not systematically apply backward design to conference presentations?  Many conferences seem to try to push presenters in that direction by requiring them to have learning outcomes for their sessions but that isn’t enough.
  • Unfortunately, pedagogy and good teaching practices are not formally taught and emphasized in most student affairs programs so I expect that most student affairs professionals have not been exposed to backward design as a formal process.  That’s a shame because it seems like such a good fit for what student affairs professionals do!  And it fits in so well with the ongoing assessment movement because it so firmly anchors design in measurable outcomes and evidence-based teaching!

Would any student affairs professionals out there want to learn more about backward design and try to apply it to some of your programs?  Please let me know because I’d love to help!  I’m positive this would work out well and I’d love to test these ideas!

When Did Student Affairs Begin Discussing Technology as a Competency?

At a presentation I attended at this year’s ACPA conference, the presenters discussed technology as a competency for student affairs professionals.  It’s a discussion that’s been going on for many years but I don’t know if many people – particularly younger professionals – know just how long it’s been going on.  The presenters of this particular session asserted that formal discussion of technology as a competency began in 2002.  Maybe they’re right but informally and on different levels this conversation has been ongoing for decades. To provide historical context for this discussion (and to substantiate some glib comments I made to those sitting next to me in the presentation), I skimmed through my historical documents to find the earliest occurrences of this discussion.

Although there is foreshadowing in the middle of the 20th century of calls for technology competency in student affairs professionals, the first explicit calls I found begin in the middle of the 1970s.  In “Dealing with the Computer,” Penn (1975) asserts that “If the modern student personnel administrator expects to provide leadership and to have an impact on his or her campus, it will be necessary to understand computers and to communicate with computer technicians” (p. 56).  He goes on to write that “the functioning of computers is still a mysterious process to many individuals” (p. 56) before going on to define and briefly discuss topics such as “hardware” and “software.”  Similarly, Peterson’s 1975 NASPA Journal article “Implications of the New Management Technology” recommends that student affairs professionals not only “familiarize [themselves] with [their] institution’s data base, its automated technology, the major administrative analytic offices, and the major reports they generate” (p. 169) but they also “develop [their] own capacity to assess, analyze, and/or use some of the more basic data sources at your disposal” (p. 169).

By the 1980s, technology as a competency was a clear concern for student affairs professionals in the U.S. In the mid 80s, several student affairs departments were engaged or interested in increasing the computer literacy and comfort of their staff (e.g. Barrow & Karris, 1985; Bogal-Allbritten & Allbritten, 1985).  In a 1983 survey of 350 student affairs departments at 2-year colleges (with 141 respondents), the second need most frequently expressed by chief student affairs officers (CSAOs) was “information about basic computer functions, computer literacy, and how to write microprograms” (Floyd, 1985, p. 258).  In 1987, Whyte described the results of a similar survey of 750 colleges and universities (with 273 respondents):

Many student affairs professionals have expressed mixed emotions regarding computerization in the educational realm. There seems to be a need for direction regarding how to coordinate computerized management, instruction, and evaluation capabilities into a meaningful, comprehensive package to assist students….Coordination of the fragmented computerization efforts of most student affairs offices into a comprehensive plan is the next logical step. (p. 85)

In describing the “Three Rs” of recruitment, referral, and retention, Erwin and Miller (1985) wrote that “to meet the changing times and increased demands for excellence, student service professionals must look for new tools to assist in problem solving. Administrators will find management information systems particularly useful…” (p. 50).  Finally, MacLean (1986) explicitly calls for computer technology (then referred to as “management information systems”) to become “integral parts of all student affairs offices and departments” (p. 5).

Calls for student affairs professionals to develop and increase their knowledge of and comfort with computer technology are decades old.  Even a quick glance through my limited resources shows implicit and explicit calls beginning in the 1970s and blossoming in the 1980s as (micro-)computers became widely available and mainstream.  The discussion has changed tenor and intensity as technology has become more intertwined with our lives but the discussion itself is not new and dates back at least 35-40 years.

References

Barrow, B. R., & Karris, P. M. (1985). A hands-on workshop for reducing computer anxiety. Journal of College Student Personnel, 26(2), 167–168.

Bogal-Allbritten, R., & Allbritten, B. (1985). A computer literacy course for students and professionals in human services. Journal of College Student Personnel, 26(2), 170–171.

Erwin, T. D., & Miller, S. W. (1985). Technology and the three rs. NASPA Journal, 22(4), 47–51.

Floyd, D. L. (1985). Use of computers by student affairs offices in small 2·year colleges. Journal of College Student Personnel, 26(3), 257–258.

MacLean, L. S. (1986). Developing MIS in student affairs. NASPA Journal, 23(3), 2–7.

Penn, J. R. (1976). Dealing with the computer. NASPA Journal, 14(2), 56–58.

Peterson, M. (1975). Implications of the new management technology. NASPA Journal, 12(3), 158–170.

Whyte, C. B. (1987). Coordination of computer use in student affairs offices: a national update. Journal of College Student Personnel, 28(1), 84–86.

Additional (older) #SAchat data: Participation, Geography, and Gender

In a comment to my previous post sharing some of my thoughts about #sachat in advance of their “State of #SAchat” discussion tomorrow, Gary Honickel asked about demographics of #sachat participants.  In our forthcoming chapter (I’m not trying to advertise it – honest! Just trying to explain why I have all of this information. I’m a researcher, not a stalker!), Laura Pasquini and I analyze #sachat and we include some information about the participants.  We didn’t include the specific information Gary asked about: gender and geographic location of participants.  But I did collect that data and although it’s for three sessions that occurred last year maybe this is still useful or helpful.  My sense is that these things haven’t changed much in the past year.

Keep in mind that these data come from three 2011 chat sessions:

Date Topic Participants Messages Average messages/participant Standard deviation messages/participant
March 10, 2011 Beyond the Conference: Networking When You Aren’t Attending a National Conference 70 442 6.3 6.5
June 2, 2011 Intentional Recruiting to the Field: Responsibilities and Liabilities 83 442 5.3 5.3
June 30, 2011 Creative Orientation Approaches and Ideas 45 323 7.2 10.2

The thing that jumps out at me in the table above are the average number of messages per participant and the standard deviation of that number.  There is immense variance in the number of messages posted by each participant and that makes me wonder about the pattern(s) of participation for each session.  The histogram below showing how many people posted a particular number of messages in each chat helps us understand these numbers (click on it to view a larger version).

This histogram is a classic “long tail” distribution, showing us that most participants in these three #sachat sessions posted very few messages and only a handful of participants posted many messages; the participant with the most messages is, of course, the moderator.  This is a very typical situation and an unsurprising finding.

This gives us a broad understanding of #sachat participation but let’s look a bit deeper and explore two different ways of classifying participants: gender and geography. First, a few words of caution: these data were inferred from the Twitter profiles and messages posted by these participants.  Geography was the easier datum to capture for each participant as most participants associated themselves with a particular college or university, either in their profile or in their introduction during one or more #sachat sessions.  Gender was much more difficult and I present these data with trepidation because there was a significant amount of guesswork involved in classifying participants as male or female.  If this were anything more than a one-off blog post or if gender were a central concern for this or any other analysis, I wouldn’t even share or use these data because inferring gender from name and photo obviously lacks rigor.

This chart shows the geographic locations of the participants in these three #sachat sessions (I used the U.S. Census geographic regions to aggregate the data).  Nothing surprising here.  #SAchat is indeed U.S.-dominated but even that isn’t a surprise.  Nothing particularly interesting is discovered if you look at the number of messages posted by participants from each region; the numbers get very small very quickly when slicing the data this many ways so it’s not worth trying to display.

 

What about gender?  For at least these three sessions, the gender breakdown seems to be about even.  Like geographic region, nothing terribly interesting happens if you slice these numbers in different ways.

So what do we make of all of this?  I think it shows that – for these three sessions – there was considerable diversity among #SAchat participants, at least in two ways we can measure. Of course, these are coarse (and in the case of gender, potentially problematic) measures and there are many other ways in which we might examine the makeup and diversity of this population.  Functional area and role (student, entry-level professional, faculty, etc.) are two measures that jump to mind as interesting and useful.  (Incidentally, I tried to classify participants using those two measures in a previous study; it was difficult, time-consuming, and very incomplete since those data are not spontaneously volunteered by all participants.)

Are #sachat participants diverse enough?  I don’t know.  How do we define “diverse enough?”  Should we be concerned about how well the #sachat population matches the larger student affairs population?  A quick glance shows some alignment between these populations but I have not done any definitive work in this area, partially because it’s very hard to obtain data about the larger student affairs population.

Of course, all of this does not and can not include anything about lurkers.  I agree that there is value in #sachat even for those who do not directly or visibly participate but we’d have to make a concerted effort to identify those people if we want to know anything about them.

I hope this is helpful or interesting!  I wish I had more up-to-date data but I don’t.  I’m job searching, working, and trying to finish a dissertation so I don’t have time or plans to gather additional data right now.  This is data that I had at hand and I am happy to share it in the hopes that it’s useful for someone.

Reflections on #sachat

Tomorrow, the members of the #sachat community will be engaging in introspection and discussing “The State of #SAchat” instead of their usual weekly discussion of topical student affairs topics.  I have been conducting research on the #sachat community for a couple of years now so I thought it might be helpful for the community if I could organize and share some of my thoughts.

I won’t spend time describing the basics of #sachat; if you are interested in this particular conversation, I assume that you are familiar with the community and its tools.  If I wrong and you are not familiar with #sachat, the official overview is here.  An annotated visualization of one chat session – a February 10, 2011 discussion about job searching – is below (my original blog post discussing this visualization has some of its background details).

The chart below shows Twitter message traffic from six hashtags – #highered, #sachat, #sadoc, #sagrad, #sajobs, and #studentaffairs – during the week of June 27, 2011.  This illustrates how #sachat differs in that it not only has consistent traffic everyday (although not as much as #highered) but it spikes during the scheduled chat session on Thursday afternoon.

In a book chapter Laura Pasquini and I have in press, we examine #sachat as a case study of informal learning using technology.  One of our conclusions is that #sachat is doing several things right to overcome the significant limitations of Twitter by:

  • Allowing participants to direct the discussions as much as practical.  For example, potential participants vote on each week’s topic and do not have to register to participate (in the voting or the actual discussion).
  • Using other tools to supplement the core use of Twitter.  Most of these tools reside on the SA Collaborative website.  One of the most important may be the chat archives that give the chats a sense of continuity and history beyond the typically ephemeral nature of Twitter.
  • Employing a well-prepared and clearly identifiable moderator in each discussion.  This account helps impose order on the Twitter chat, allowing conversation to run for a bit before drawing it back to the core topic by using clearly marked, pre-prepared questions.

We also identify several specific concerns and challenges:

  • Can the participants continue to overcome the inherent limitations of Twitter, especially its (a) short message length, (b) lack of threading, and (c) ephemerality?  Although some participants attempt to overcome the first limitation using multipart messages, this is not very successful; the 140 character limit of Twitter is one of its core features and unlikely to be overcome.  The second limitation has been addressed with some success with the use of MOD messages and Q# replies.  The third limitation has been partially overcome by regularly making transcripts of chats publicly available.
  • Is the small community of volunteers that run the chats – those who use the moderator account and the SA Collaborative website – sustainable?  These volunteers and the tools they provide and maintain are essential to the success of the community.  For how long will these volunteers sustain their energy and will there be a smooth transition as members come and go?
  • How representative of the larger student affairs community is the #sachat community?  Is that important?
  • How diverse are the members of the #sachat community?  In what ways are they diverse and in what important areas is diversity lacking?

NASPA Expands Voting Rights to All Members

I have been extremely critical of NASPA’s disenfranchisement of graduate student members, especially since that effectively negated the membership’s desire to merge with ACPA. So I was very happy to receive the following message in an e-mail from NASPA:

After a month-long voting period, the NASPA voting delegates overwhelmingly approved a proposal to revise the voting structure of the association to allow associate affiliates, graduate student affiliates, and emeritus affiliates the opportunity to vote in elections for the chair of the NASPA Board of Directors (previously NASPA President) and Regional Directors (previously Regional Vice Presidents).

“As a result of member feedback, the Board of Directors voted unanimously in May to submit this Bylaw Amendment to NASPA’s Voting Delegates,” said NASPA President Patricia Telles-Irvin. “I feel strongly that this was the right thing to do at this point in time, and I am so gratified that the Voting Delegates agreed and voted so overwhelmingly in favor of the change.”

“Graduate students, in particular, have been increasingly active within NASPA and have been its fastest growing membership type over the past year,” said NASPA Executive Director Gwendolyn Jordan Dungy. “I am particularly pleased to see the governance structure adapted to better recognize the contributions our members along the full spectrum of the student affairs career trajectory.”

The expanded voting rights will go into effect immediately with January’s ballots.

That this was necessary and that the organization denied full voting rights for over a quarter of its membership will remain stains on NASPA’s history. But it’s wonderful that the voting delegates have voted to remedy this injustice as we move forward. Well done, NASPA!

Habits of Successful Higher Ed Doctoral Students

I recently moved to a new apartment and as I was unpacking I came across my notes from last year’s NASPA Doctoral Seminar in Chicago. One page of notes is from a panel discussion where faculty discussed habits and traits of successful doctoral students. Carney Strange moderated the session but I don’t remember or have written down the names of all of the faculty on the panel. I know Deborah Liddell was on the panel because I specifically noted a quote from here. I think George Kuh was also on the panel and I only remember that because he was a faculty member at my institution and the director of the research center at which I worked.

The most successful Higher Education doctoral students…

  • Read
  • Write
  • Read others’ dissertations
  • Keep a writing journal or log
  • Treat their education like a job, including scheduling reading and writing (this tip was aimed particularly at part-time students)
  • Know their motivation(s)
  • Do the damn thing e.g. don’t read about writing a dissertation, just sit down and write it
  • Know that doctoral studies is not about their capabilities; everyone admitted to a doctoral program is capable of completing it
  • Remembers that “it’s just a place to develop habits”
  • Asks questions
  • Knows that “it’s about how you lean into life” and life still goes on outside and beyond their studies
  • Are willing to stick their feet in the water without knowing what will happen e.g. take risks, display trust
  • Know that their dissertation is not their life’s work
  • “Wrestle [their] perfection to the ground” – Deborah Liddel, University of Iowa

Personal Update: It’s Already August???

I’ve been quite disconnected for the last couple of months. I think that I am almost reconnected and settled into my new apartment so I will soon be back to myself with some updates for this blog. Quick thoughts are listed below in no particular order; please let me know if you’d like me to elaborate on any of them.

  • My time at the Oxford Internet Institute’s Summer Doctoral Programme was amazing. This was the third young scholar/advanced doctoral student program I have attended and it was by far the best one. The program was fantastic, the location amazing, and the faculty and participants are as kind as they are intelligent.
  • It took nearly a week for my cable company to get my Internet connection working in my new apartment. I’ve never been more isolated or more productive. Coincidence? I think not.
  • Perhaps as a result of my concentrated time in Oxford focusing on Internet studies and my time in a research center, I am feeling more and more disconnected from the student affairs profession. I continue to wonder about the priorities of the profession and the academy-at-large, especially as we continue to adjust to a new reality of limited funds and increased public scrutiny. Although I agree that most of the services provided by student affairs units are good and useful I don’t know if adults should be forced to fund those services. At a more basic level, I don’t know if all of these services should be performed by colleges and universities even if they do contribute to enrollment, retention, and overall well-being.
  • I am immensely saddened and angered by the continuing slap fight between ACPA and NASPA. It’s unprofessional, wasteful, and embarrassing. I have already decided to let my NASPA membership expire and I am edging toward allowing my ACPA membership expire, too.
  • I don’t think we’re quite ready to make a public announcement but I’m extremely excited about a partnership between my current employer and another of my favorite organizations. I’m smack in the middle of it all and so happy to be there!
  • I said “no” today and I’m very proud of myself because it’s not something I do as often as I should. I really wanted to work on the project, too, so I’m a tiny bit sad about the timing. But my time is limited and I must develop and maintain focus.

Upcoming Student Affairs Technology Conferences

After many years of being a side-discussion at other conferences, technology in student affairs is finaly taking center stage at two upcoming conferences:

  1. The Student Affairs Technology Unconference is being held on July 29, 2011, at Boston University. Although the agenda is not set (and will not be set until the attendees set the agenda at the conference itself, one of the defining features of an unconference), this unconference is aimed at student affairs and higher education administrators who use technology and want to connect with others who share their interest. The conference is being set up by several persons who frequent the #satech Twitter hashtag; use #satechBOS to follow them. The event is free with participants responsible for their own lunch.
  2. The #NASPAtech: Student Affairs Technology Conference is scheduled for October 27-29, 2011, in Newport, Rhode Island. In contrast with the Boston event, this will be more of a traditional conference with a set schedule, invited speakers, and a call for programs that closes on July 22. The schedule has as many timeslots dedicated to unconference sessions as it does traditional concurrent sessions. This event seems to be aimed at the same general population as the Boston unconference: Student affairs technology users and enthusiasts.

I’m disappointed that I won’t be attending either of these events. I will be returning from England just a few days before the Boston event and the turnaround is just too quick for my comfort. I won’t attend the NASPA conference because (a) I will be attending and presenting at another conference and (b) I don’t care to support NASPA right now. (And while I’m being a Debbie Downer, I’ll also note that these conferences both seem to be aimed at the same audience with those who (a) build and support and (b) study the technologies and their users still lacking homes of their own.)

It’s exciting to see these events on the horizon! I hope this is a sign of more good things to come for those who work with technology in student affairs and other areas of higher education.

Confessions of an Uninvolved Student

This is a further development of thoughts that occurred to me as I read and responded to John Gardner’s latest post.

I have worked in student affairs and I have a Master’s degree in that field. I am a PhD Candidate in one of the world’s best higher education programs. I work at the National Survey of Student Engagement. These experiences and education have firmly drilled into me the benefits of being engaged and active in campus groups, events, and activities. I see and hear from my colleagues and my students the incredible impact of these activities, especially the acquisition of lifelong friends.

Here’s my secret confession: I was involved in virtually nothing as an undergraduate and a Master’s student. I can only name two fellow students from my undergraduate alma mater; I’ve scarcely exchanged Facebook messages with them and haven’t spoken to them since I graduated from the University of Tennessee (with a 2.48 GPA; “C is for cookie, that’s good enough for me!“). The story isn’t much different for my Master’s classmates; with one exception, I only keep in touch with them through coincidental attendance at professional conferences.

My lack of campus involvement was my choice, for good or ill. It’s part of who I am and I can’t envision my life any differently. And I don’t think anyone could have convinced me to act differently or be different.

I make these confessions because I know there are many other students who are making the same decisions and I don’t think those students and their decisions are understood by or respected by many of my colleagues, especially those in student affairs. I get the impression that sometimes those students are viewed with pity and even scorn because they choose not engage in our favored activities in our chosen environment. And that saddens me, especially because we preach the benefits of diversity and choice. Many of us believe those students need to be “saved” but that seems very disrespectful of those students and their choices.

Could Graduate Student Members Have Changed the NASPA Vote?

I’ve stated that the NASPA vote against consolidating with ACPA would have been different if graduate student members could have voted. This is largely influenced by my emotions, intuition, and experiences. But how much truth is there in this belief? Can we find evidence to support or refute this assertion by examining the results of the vote and membership data? Would it really have made a difference if graduate students could have voted?

Data and Assumptions

I’m having trouble finding membership data but I have found enough to make some rough calculations. According to the latest Executive Director’s Report to the Board of Directors, in January NASPA had 12,388 members. At about the same time, the co-chairs of the New Professionals & Graduate Students Knowledge Community (NPGS KC) wrote that there were over 3,000 graduate student members in NASPA. Finally, NASPA is reporting that 42% of eligible voters participated in this vote and 62% of them voted for consolidation.

Let’s assume that all of the numbers above are correct or at least close enough for some rough calculations. Let’s also assume that one-quarter of the NASPA membership was ineligible to vote. Graduate student members make up almost one-quarter of the NASPA membership so this assumption is conservative because associate affiliate members could not vote, either. We’ll make this assumption even more conservative and assume there are 3,000 graduate student members. Finally, let’s assume that the straw poll conducted by the NPGS KC is predictive of how graduate student members would have voted and 82% of them would have supported consolidation.

If 42% of eligible voters participated in the vote, that means that 5,203 members voted. Sixty-two percent of those members – 3,226 members – voted for consolidation. Two-thirds of them would have had to vote for consolidation for the motion to carry.

Calculations and Results

Let’s explore two scenarios. In the first scenario, let’s assume that the same proportion of graduate student members participate in the vote as the rest of the membership. In other words, let’s assume that 42% of the graduate student members – 1,260 members – participate in the vote. And as stated above, we’ll assume that the NPGS KC straw poll is predictive of student membership voting preferences. Do these additional 1,033 votes for consolidation meet or exceed 66% of the total number of votes?  Yes, but barely.  That would have resulted in 66.9% of the voters in favor of consolidation, just over the 2/3 required.

In our second scenario, let’s assume that only those student members who responded to the NPGS KC straw poll participate in the consolidation vote. In that case, only 547 new votes are added to the total. The additional 447 votes for consolidation only increases the total percentage of consolidation votes to 64.4 so these additional votes do not change the final result.

Discussion

As demonstrated by the two scenarios described above, graduate student members would have had to participate in a higher proportion than the general membership and voted for consolidation by a huge margin to have changed this vote. We have good reason to believe that student members would have overwhelmingly supported consolidation. We don’t know how many of them would have voted and whether enough of them would have voted to change the results; it’s very plausible.

In this brief exercise, the assumption that seems weakest is that the NPGS KC straw poll would have been predictive of the behavior of the entire student membership of NASPA. This is primarily due to the fact the straw poll was only administered to the members of the NPGS KC and we don’t know how representative those members are of the larger student membership of NASPA. Personally, I believe that student members would have overwhelmingly voted for consolidation in line with the straw poll. But I don’t know how many students would have voted and I am not confident that the straw poll can tell us much about that.

Conclusion

It is likely but not inevitable that graduate student members would have changed the result of this vote. Evidence seems to show that graduate student members were solidly in favor of consolidation.  But we don’t know if enough of them would have voted to change the final result; it’s likely but not certain.

Of course, this exercise in arithmetic ignores all social, cultural, and historic issues (and many others).  If support for consolidation was indeed extremely high among graduate student members, what emotional impact does it have for their votes to have not been counted even if they would not have changed the final result?  Will graduate students feel more aligned with ACPA who allowed student members to vote and whose general membership seemed to favor consolidation by the same margin as graduate student members of NASPA? Finally, how much does it matter if the graduate student vote could have changed or not changed the final result?  How much weight is carried by the symbolic act of inclusion or exclusion?

(And what about the associate affiliate members who were also denied the right to vote?  If they could have voted, how many would have voted and for which result?)

Next Page »