Academic Assessment in Higher Ed
       |           

Welcome, Guest. Please login or register.
Did you miss your activation email?
March 19, 2024, 02:17:09 AM
News: Election Simulator 2.0 Released. Senate/Gubernatorial maps, proportional electoral votes, and more - Read more

  Talk Elections
  General Politics
  Political Debate (Moderator: Torie)
  Academic Assessment in Higher Ed
« previous next »
Pages: [1]
Author Topic: Academic Assessment in Higher Ed  (Read 911 times)
anvi
anvikshiki
YaBB God
*****
Posts: 4,400
Netherlands


Show only this user's posts in this thread
« on: February 25, 2012, 10:52:28 AM »
« edited: February 25, 2012, 11:04:32 AM by anvi »

We don't have an "Education" discussion board, so not knowing exactly where to post this, I chose to put it here, since assessment in higher ed is connected to school reaccreditation by state education boards, so it is a political issue.  As I'll try to demonstrate, the origins of academic assessment are political too.  If someone wants to move the thread, though, I'll understand.

I have written posts in various threads in the past on assessment tests in education, but, after attending a meeting at my institution last week, I had a chance to sit down and write some of my thoughts down in a more coherent and systematic fashion, so I'll post them in their entirety here.

Two weeks ago, I was dragooned into attending a College of Liberal Arts meeting at my institution, led by the new dean and the ever-more important tzar of assessment.  During a diatribe of the latter about why an assessment plan for the College I had worked on with other colleagues last year for nine months was "very complicated" (it really wasn't) and likely wouldn't be implemented, I sat near the back of the room, grateful that I had not brought food to the meeting lest I hurl it at him with abandon.  "How," he asked, beginning a mantra often heard among assessment devotees in college administrations these days, "do we know that our graduates can write well?"  As he said this, my mind flashed back onto a scene from a department orientation for my very first teaching job at the college level in remedial composition seventeen years ago at another institution.  The coordinator at this orientation announced that they would begin to move away from the teaching of grammar in these classes, even though they expected us to continue to assess it in some measure, in order to move closer toward teaching the students how to be "better conversationalists" and "academic thesis" writers.  I vowed to myself that I would devote some time in all of my sessions to teaching grammar anyway, even though many of my fellow graduate assistants appeared to greet this announcement with a sigh of relief.  At that moment in last week's meeting, I realized that an astonishingly straight line connected this distant memory to my current assessment tzar's bitter tirade.

It remained the case, despite this change of plans in the composition department I worked in all those eons ago, that progress through one's freshman year in college still worked much like my own did when I attended undergraduate school.  If you didn't test into Comp 101 as a freshman, you took your remedial comp, then 101 and 102, along with 100-level general education classes and 100-level prerequisites in your intended major.  It was only after successful completion of 102 that you were allowed into 200-level and above classes, which required progressively more difficult writing assignments involving research and argument appropriate to the distinct fields you were studying.

But two things began to happen in rapid succession at that point in universities all across the country.  

The first was the growing pervasiveness of the assessment movement in higher ed, which was "founded" by the Learner Centered theorists of pedagogy ten years before my initial college teaching job.  By the late eighties and early nineties, Commissions of Higher Education in states began to require some kinds of assessment reports from colleges and universities for the purposes of the latter qualifying for another decade of reaccreditation from the state.  

The second thing that happened was the steadily increasing demand for increasing enrollment and retention.  With University budgets bulging, mainly as a result of a glut of ever-increasing, highly compensated administrator positions and student services facilities combined with ever-shrinking state and federal education spending, the heat was on to make sure the college admitted more students and kept them there

These enrollment pressures, felt in practically every department in the institutions of higher learning, slowly but surely brought down the walls of prerequisites for upper-division courses, so that presently, a student without Comp 101 or 102 may sign up for a 300 or 400 level course, at my institution and many, many others.  This process, combined with the abandonment of nuts-and-bolts grammatical instruction in many remedial and entry-level composition courses, has suddenly placed every single instructor, at every level of teaching in the University, in the position of being a professor of both their subject matter and remedial comp.  And thence comes the demand from the assessment regime in college administrations for standardized assessment rubrics, to ensure that "we," meaning "they," the administrators, state reaccreditation board, state legislators and taxpayers, can be assured that our graduates, who may not have ended up finishing Comp 102 until their senior year, can write a complete sentence when they begin to apply for jobs after their hats and tassels have floated back down to earth.  And they will graduate, you see, because, if we teachers flunk too many students in our classes, that hurts retention, and we get dinged for that too.

While all this is going on, the entire compliment of instructors at a university, having been drafted into the multitudinous army of sentence fragment police while serving double-time on the front lines as physics, math, psychology and philosophy teachers, are really not trusted to be up to the job by their governing administrators.  A rigorous vetting process that selected a new teacher from a pool of literally hundreds of candidates, followed by another six-year vetting process for tenure (on the 35% of new occasions where tenure-track positions are available nowadays) that reviews teaching performance does not seem to create that confidence.  Of course, admittedly, it's hard to do, since the teacher mentoring process for new instructors is often only nominal at best, and when the students, the institution's "customers," play such an influential role in tenure process by submitting their evaluation forms at the end of each term for all their new teachers.  It's rather likely that the forms the students submit would be better suited for the Nielson Ratings than a tenure committee, but, once again, what passes for the priority of retention wins this battle too.  And so, the administrators insist on regular submission of assessment results, so that "we" can all be assured that students who graduate from college can write in their native language.

Assessment, at the end of the day, is a politician's idea of creating "accountability" in education, and has precious little to do with pedagogical enhancement.  Were we really serious about knuckling down and making our students into better writers again, in this age of incomprehensible text message abbreviations, we would reinstitute the regime of writing prerequisites and insist that remedial and 100-level composition courses employ instructors that both can and do teach grammar so that the students can be ensured at least a year of ongoing concentration on better writing.  This would in turn free other teachers in upper-division classes to focus on various forms of disseminating discipline-specific writing skills.  I am often complimented on how well I write, but this skill, to the meager degree that I possess it, did not fall out of the sky and land on my keyboard; it was acquired through the very practice that the prerequisite program forced me to continue.  In addition, new teachers should be put through real, instead of fictive, mentoring programs where they are observed and shown by veteran teachers a variety of sound pedagogical methods to apply to different possible learning challenges, for which they must show progress that bears weight on decisions regarding their promotion.  Student feedback should be welcomed and obtained, certainly, for learner-centered approaches undoubtedly have merit and there are different learning-styles in every classroom that teachers do have to be prepared to accommodate.  But such feedback should exert far from the greatest amount of influence on the evaluation of teachers.    

But we do not do these things.  And the reason that we don't is that, for some time now, enrollment has been more important than ensuring virtuous writing skills in the University.  Administrators cannot reasonably maintain this priority, which effectively prevents the restoration of more sound curricular choices, and at the same time fairly harass their entire faculty about the need for every class to implement a standardized framework of remedial composition evaluation.  I say this, despite appearances, with some real understanding of and sympathy for the administrators' predicament on this issue; the state boards have given them their marching orders and will withhold recertification of a school unless those numbers are turned over.  I served as a department assessment coordinator and on the college-wide assessment board at my last place of employment, and have served in similar capacities at my present institution.  I have always been willing to help turn over numbers in the desired formats.  But, please, please, for the love of sanity and decent common sense, please do not demand that I believe in those numbers.  They are fundamentally irrelevant measures of pedagogical effectiveness.  Anyone who has taught classes for even only two semesters knows very well that a teaching technique that produced fantastic results with a group of students one semester will flop the very next term with a different group.  Good teachers learn how to adjust to this in their own classrooms, which is one reason you want mentoring for new teachers, but also with precise observation and knowledge of students, flexibility and an investment of time and commitment; state education boards don't.

But, until changes are made to the irrational assessment regime, I say that, in addition to running higher ed assessments, I think we should run another set of assessment exams in state legislatures and Congress.  As a taxpayer, we, the citizens, would really like to know how many of our representatives actually read, and understand, the bills they vote on that determine what our lives will be like and how our civilization will fare.  Thanks!
Logged
Yelnoc
Junior Chimp
*****
Posts: 7,127
United States


Show only this user's posts in this thread
« Reply #1 on: February 25, 2012, 06:51:08 PM »

Anvi, I'm curious just how bad freshmen writing is.  Do people really use bad grammar and txt msg slang in college level essays?
Logged
anvi
anvikshiki
YaBB God
*****
Posts: 4,400
Netherlands


Show only this user's posts in this thread
« Reply #2 on: February 25, 2012, 07:51:44 PM »

It varies, Yelnoc, both within schools and between them.  At all the institutions where I have taught, students who do not test into comp 101 and need remedial comp, which amounts to a good share of students, often can't write a complete grammatically correct sentence, and often write in abbreviations and conversational idioms.  Once a student has made it through comp 102, at the end of their freshman year at the earliest, they have improved some, and know how to write a short essay that is basically coherent and organized.  But, as noted above, without the prerequisites being uniformly enforced, students might not finish their comp requirements until very late, and in that case, systematic writing instruction may fall through during the remainder of their coursework.  That is why the college wants standard writing assessment rubrics from all of the classes offered in the curriculum.  But, it's ironic, of course, because it was the universities that dropped the prerequisites in the first place, and now, in order to hold up enrollment, they add the assessments instead.

I think, as Torie alluded to in another thread, the poor writing skills many students come to college with are often one of many shortcomings of modern high school education in various places.  I remember having to write several longish research papers in high school English and history classes, and I think this is still the practice in some places; but in others, barely any writing seems to be going on in high school at all.

How is your high school, Yelnoc?  How much writing do you do?  You write pretty well on this forum, so I'm assuming they give you some good practice and instruction.  

    
Logged
Yelnoc
Junior Chimp
*****
Posts: 7,127
United States


Show only this user's posts in this thread
« Reply #3 on: February 25, 2012, 08:48:54 PM »

It varies, Yelnoc, both within schools and between them.  At all the institutions where I have taught, students who do not test into comp 101 and need remedial comp, which amounts to a good share of students, often can't write a complete grammatically correct sentence, and often write in abbreviations and conversational idioms.  Once a student has made it through comp 102, at the end of their freshman year at the earliest, they have improved some, and know how to write a short essay that is basically coherent and organized.  But, as noted above, without the prerequisites being uniformly enforced, students might not finish their comp requirements until very late, and in that case, systematic writing instruction may fall through during the remainder of their coursework.  That is why the college wants standard writing assessment rubrics from all of the classes offered in the curriculum.  But, it's ironic, of course, because it was the universities that dropped the prerequisites in the first place, and now, in order to hold up enrollment, they add the assessments instead.

I think, as Torie alluded to in another thread, the poor writing skills many students come to college with are often one of many shortcomings of modern high school education in various places.  I remember having to write several longish research papers in high school English and history classes, and I think this is still the practice in some places; but in others, barely any writing seems to be going on in high school at all.

How is your high school, Yelnoc?  How much writing do you do?  You write pretty well on this forum, so I'm assuming they give you some good practice and instruction.  
Students who write that way in my current teacher's class (Gifted British Literature, a Senior level class but full of Juniors) fail, without exception.  We have only written two essays this semester so far; last semester we might have written four.  A major component of the grade in that class is oral presentations, which are difficult for me though I am slowly overcoming my anxiety of speaking (speaking in front of 30 deathly silent students and a teacher peering into my soul).  I am actually failing the class at the moment, but that's because I wrote my first essay with a concussion.  Keep in mind though, this is the top "gifted"* class in the school.  I imagine your average high school English paper contains more mistakes, though anyone who thinks they are texting a research paper should not be admitted to any college.

With that said, I don't know that I learned that much about writing from my high school language arts teachers.  While you're kind to say I write pretty well on the forum, everything I post is hastily thrown together without even a quick read-over.  My "good writing" is squirreled away on my hard drive, stories, essays, and whatnot.  I dreamed of being a published writer since I was young, and so I began writing as a kid.  The key to writing well, I think, is reading well written books and writing often on your own time.  Most of high school level English classes revolve around analyzing literature, composition is rarely touched upon.  One thing my teacher has made a point of, though, is failing papers with too many "be verbs" (we are allowed three per two page essays).  Do too many "be verbs" kill a paper in college?  When writing leisurely, in narrative form, they are easy to form, but "could, would, should, is, are, was" and all the rest slip into drab essays quite easily.

*I really dislike the idea of separate gifted/accelerated classes.  "Gifted" students performed above average on a standardized IQ test in early elementary school, and consequentially were  placed in classes with objectively better teachers who expected more of them.  That means being a good guesser at the age of eight of nine is the key to a better education, at least in my school system.
Logged
Michaelf7777777
Rookie
**
Posts: 76
New Zealand


Show only this user's posts in this thread
« Reply #4 on: February 26, 2012, 03:03:15 AM »

Thanks for the insight. I never realised that this situation was so bad in the USA as in New Zealand (at least at Victoria University of Wellington) you get marked down for poor spelling and grammar although it accounts for (at least in the assignments where they give you a sheet telling you what % of the overall grade is for certain qualities in your paper) spelling and grammar accounts for between 5 and 25% of the overall grade for an assignment at least for essays. In tests and exams the rule seems to be as long as the marker can understand what you're writing then its all good.
Logged
anvi
anvikshiki
YaBB God
*****
Posts: 4,400
Netherlands


Show only this user's posts in this thread
« Reply #5 on: February 26, 2012, 12:59:09 PM »
« Edited: February 26, 2012, 01:01:02 PM by anvi »

Michael,

Welcome to the Forum!  What you're describing sounds a great deal like what passes for grades given for the writing component of assignments here, but unless it's a composition class, generally papers don't get deducted up to 25% for bad writing mechanics.

Yelnoc,

Thanks for your detailed reply.  Yeah, it does sound like you have some inequitable class placement policies at your school.  But it's nonetheless great that you're in classes that emphasize essay writing.  Please keep to your ambition to be a published author!  If the written materials on your hard drive are better still than your writing on the forum, I'd say that's a very achievable goal.  I think you're right that many good writers are also prolific readers, and learn how to imitate styles they like.  In my field of study, I admired writers that were very lucid but succinct and to the point, so I try to imitate that in my own writing.  I'm far from successful much of the time.  I think the reason for that is that I did research in Germany for a cumulative year and a half, and German writers in my field tend to use almost endlessly long sentences, with unbelievable numbers of subordinate clauses.  So, when I wrote a few essays in German, I picked up that habit and it's stuck with me, unfortunately.  But good writing takes constant practice and self-correction, it's never really a "done" deal.

Yeah, at a certain point in composition, we like to get students to resist using too many "be" verbs.  Compositions that have too many indicative verbs tend to look tedious and vaguely like lists of things fairly quickly.  The more ways you can work active verbs into compositions and use indicatives only when necessary, the better.
Logged
Michaelf7777777
Rookie
**
Posts: 76
New Zealand


Show only this user's posts in this thread
« Reply #6 on: February 26, 2012, 02:13:08 PM »

Michael,

Welcome to the Forum!  What you're describing sounds a great deal like what passes for grades given for the writing component of assignments here, but unless it's a composition class, generally papers don't get deducted up to 25% for bad writing mechanics.

Yelnoc,

Thanks for your detailed reply.  Yeah, it does sound like you have some inequitable class placement policies at your school.  But it's nonetheless great that you're in classes that emphasize essay writing.  Please keep to your ambition to be a published author!  If the written materials on your hard drive are better still than your writing on the forum, I'd say that's a very achievable goal.  I think you're right that many good writers are also prolific readers, and learn how to imitate styles they like.  In my field of study, I admired writers that were very lucid but succinct and to the point, so I try to imitate that in my own writing.  I'm far from successful much of the time.  I think the reason for that is that I did research in Germany for a cumulative year and a half, and German writers in my field tend to use almost endlessly long sentences, with unbelievable numbers of subordinate clauses.  So, when I wrote a few essays in German, I picked up that habit and it's stuck with me, unfortunately.  But good writing takes constant practice and self-correction, it's never really a "done" deal.

Yeah, at a certain point in composition, we like to get students to resist using too many "be" verbs.  Compositions that have too many indicative verbs tend to look tedious and vaguely like lists of things fairly quickly.  The more ways you can work active verbs into compositions and use indicatives only when necessary, the better.

Anvi thanks for the welcome. Sorry I misinterpreted what you said as it having no impact on grades. The 25% components have usually been on 1st year papers with the amount gradually lessening.

Another thing I've remembered is that lecturers and tutors have said that when marking things they get an idea of what the quality of the paper is and then use the marking schedule to justify their original gut instinct on the quality of a paper so I do think that good spelling and grammar can certainly better the marker's original impression and therefore better your grade.
Logged
Yelnoc
Junior Chimp
*****
Posts: 7,127
United States


Show only this user's posts in this thread
« Reply #7 on: February 26, 2012, 03:05:13 PM »

Here, mechanics are generally 30% of the grade.  When writing research papers, in violation of MLA format is a zero offense error.  Last year, my friend made a 63, I believe it was, on an essay he should have made a 93 on.  Unfortunately, he reversed the date and class period in the header, and so was deducted thirty points.  Stuff like that is why I hate my English classes.
Logged
Michaelf7777777
Rookie
**
Posts: 76
New Zealand


Show only this user's posts in this thread
« Reply #8 on: February 26, 2012, 03:09:01 PM »

Here, mechanics are generally 30% of the grade.  When writing research papers, in violation of MLA format is a zero offense error.  Last year, my friend made a 63, I believe it was, on an essay he should have made a 93 on.  Unfortunately, he reversed the date and class period in the header, and so was deducted thirty points.  Stuff like that is why I hate my English classes.

Yeah seems from what you say to be extremely harsh. Over here you'd probably be deducted 1 or 2% at most and perhaps have a reminder not to do it again (perhaps with a general reminder of the problem generally)
Logged
Hash
Hashemite
Moderators
Atlas Superstar
*****
Posts: 32,398
Colombia


WWW Show only this user's posts in this thread
« Reply #9 on: February 29, 2012, 09:10:28 AM »

That's a pretty interesting reflection. I think the same things can and should be said about HS English classes. I don't recall a serious lesson in grammar since, what, Grade 6-7 English maybe? I'm not counting the useless exercises they do in pseudo-grammar for 5 minutes once a month or whatever, but actual serious grammar. My grammar in English is pretty awful and I don't know any details about grammatical conventions. Hell, the language where my grammar is probably best is ironically Spanish.

And I say this as an IB English HL (higher level) student, which is suppose to reflect the highest standards in English. Yet, the quasi-entirety of two years of HL English were spent on literature and on learning stuff about literary techniques which would be great for some uni English major but otherwise useless for someone who's going into some other major. The Language B classes in IB (I did French) were pretty much just as useless, preferring to teach you how to write random bullsh**t texts in that foreign language rather than actual grammar.

I did take a writer's craft class in grade 12, but the teacher was careless and useless (as was the class, tbh), and the class didn't teach how to write useful stuff (research essays, critical analyses etc) but rather how to write stuff you're more likely to use for work (business letters) or stuff you'll never use in academia (newspaper articles, or a 50-100 page story). Of course, I tend to think I write pretty well and my English teachers have often said so, but that's because I've always read stuff and I've always enjoyed writing and I've been writing a blog since 2008.

I graduated from IB English with a 6, equivalent to a 90% grade or so, and this grade exempted me from uOttawa's two mandatory English comp and lit courses (1100 and 1101 iirc). In hindsight, I've very happy that I wasn't forced to take those classes, because I've only heard bad things about them. I've done well on almost every single essay and they've usually given me good marks on the few marks assigned for grammar or style. On the other hand, my profs have complained at times about how bad some of the essays they got were. Stuff like "Plato was a great man and we should really study him" in an academic essay on Platonic philosophy. The standards shift from prof to prof, some profs don't even publish a rubric, some other profs publish the most anal rubrics (I had one idiot whose rubrics were like 'Your Paragraph 2 should be 22-23 lines' or else you'd lose 5 points); but overall they seem to expect comprehensible and fairly good grammar.
Logged
opebo
Atlas Legend
*****
Posts: 47,010


Show only this user's posts in this thread
« Reply #10 on: February 29, 2012, 10:13:27 AM »

It is definitely a mistake to assume 'assessment' or any other application of stressors and annoyances to profs can improve writing skills.  Capitalism has made children idiotic, and there's nothing the poor teacher can do about it.
Logged
TJ in Oregon
TJ in Cleve
Junior Chimp
*****
Posts: 8,952
United States


Political Matrix
E: 0.13, S: 6.96

Show only this user's posts in this thread
« Reply #11 on: February 29, 2012, 11:01:44 AM »

One of the interesting exercises we had to do in high school English was write papers following an arbitrary set of rules that included forbidding us to use infinitives, linking verbs, a collection of words that were deemed poor writing, such as the adjective "good", or start sentences with pronouns. It wasn't necessarily the best way to write but it forced everyone to be really aware of how they were constructing sentences.
Logged
Kaine for Senate '18
benconstine
Atlas Superstar
*****
Posts: 30,329
United States


Show only this user's posts in this thread
« Reply #12 on: February 29, 2012, 07:48:35 PM »

I guess my school is different.  I cannot imagine any of my classmates having trouble writing halfway decent papers.  Then again, I suppose my school is the exception, in that I live in one of the richest and best educated areas in the country.
Logged
Pages: [1]  
« previous next »
Jump to:  


Login with username, password and session length

Terms of Service - DMCA Agent and Policy - Privacy Policy and Cookies

Powered by SMF 1.1.21 | SMF © 2015, Simple Machines

Page created in 0.234 seconds with 11 queries.