Sunday, June 29, 2008

PDA - getting started

I'm not entirely sure what the purpose of this assignment is but I'm concerned that its intended purpose is a type of portfolio that could, at least in theory, be used when recruiting or interviewing for a job. Although I used to believe that taking a digital portfolio to a job interview was a great idea, I've learned from experience that administrators don't have time to look at them. I've been recruiting four times in seven years and taken a digital portfolio to three of those fairs and I only know of one school that took the time to pop a CD into their laptops so they could have a look; the fairs are really about meeting face to face because our resumes have been screened long before.
I don't want to sound negative; if the purpose of the PDA is something else, then I just need to understand what the purpose but is; however, if it's for recruiting purposes...

Thursday, April 3, 2008

data sample

Let's see, I'm supposed to share what I was trying to do and then share some data to see if I'm analyzing it correctly; here goes.
The focus of my t.i.p. was to see if the concept of authentic learning actually carries any merit: specifically, if publishing work for an audience offers a greater learning experience than simply handing in an assignment to the teacher who is usually the only person who ever reads the work. All of this is based on the concept that authentic experiences are intrinsically motivating because students can make the connection between the work they are doing and the real world, unlike traditional school assignments. If this is true, the assumption is that the final product will be better when the students want to do the work rather than doing the work because the teacher told them to. However, before looking at how intrinsic motivation effects the quality of work, I decided I had better confirm that authentic learning, in this case, publishing for an audience, would actually increase intrinsic motivation.
Within my qualitative data, I found that prior to beginning their wiki assignments, which the students were told was not being graded (and therefore did not have an extrinsic motivator), 60% of students said they enjoyed writing assignments. Because I asked them if they enjoyed writing assignments rather than just writing, I've assumed that there original answers are based on the effects of extrinsic motivations (grades, teacher & parent approval, etc). After working on their wiki projects however, this number rose to 68%. I therefore concluded that using wikis, which provided the students with an authentic learning experience was more enjoyable and therefore more motivating than traditional writing assignments and activities. In addition, many of the studies on motivation I read about concluded that the absence of extrinsic motivational factors would increase the likelihood of intrinsic motivation. Therefore, I believe that the 8% increase is a result of two things; writing for audience and writing because they where encouraged to instead of being told they must.

thinking out loud...missed opportunities


Now that I've collected all the data I can before I begin putting together my presentation and writing my paper, I've had several off the record chats with colleagues who are interested in my t.i.p. I've found these lunch time discussions really helpful because as I'm explaining what I did and what I was hoping or expecting to find, I start thinking about all the things that I could have done different or will do differently for the presentations.
For example, so far it looks like wikis aren't a great motivator since over 57% don't want to use wikis in the future.
I'm also trying to figure out the best way to share some of my data. My qualitative questions offered a range of possible answers for each question from "strongly agree, agree, disagree, strongly disagree." I'm not sure what I was hoping to learn from this range of possible answers but when displayed in a graph, it becomes a confusing mess of pre and post "agreeable-type" answers. So instead, in my infinite wisdom, I've decided to condense my data into pre and post "agree" - full stop. Since I'm working in percents it seems to me this is the easiest way for the audience to make sense of my data and for the life of me, I can't think of any drawbacks. If you can think of any, I'm all ears. I've already typed it all up into excel from survey monkey so if there is a valid argument for presenting it all, it's no skin off my nose.
I also should have done more research into motivation before planning and implementing my project. Thankfully, after reading several articles and research from the last 30 years, it seems I was on the right track (according to the research) but I don't think my data supports this theory.
Something, somewhere went terribly wrong.
Anyway, live and learn. I don't think I learned a lot about how to best use wikis in a classroom, if at all but I have learned some of what works and what does not when doing research. I suppose that's the point. I hope.

Thursday, March 27, 2008

data insite

As I sift through the data I'm beginning to see where I went wrong or perhaps a better way of putting it is "I know how I could do this better next time."
In short, in an ideal world I would have used the very tool I was asking my students to use if for no other reason, to avoid the pitfalls that have impacted the project in a less than ideal way.
For example, the least successful part of this project has been getting other teachers/schools/students on board. This isn't to say that those who are involved haven't tried their damnedest but I see now that it would have worked better if I could have planned this project with other interested teachers instead of asking other teachers to "help me out" with my t.i.p. This way, we would have shared the same vision and avoided tech issues like "The Great Firewall of China."
In retrospect, I should have known this because David Larson was asking me the right questions last summer but because they were hard to answer I chose to avoid them rather than face them head on. I should have listed to you David!
Anyway, I know I need to expand on this in my paper but thought I'd better get this down now so I don't forget about it.

the end is in site...

Okay, since I wrote last I've not done a lot but the data collection has begun. In fact, I'm hoping to have it completed before the end of next week. I've also gone over my post surveys and tweaked them a little so they focus on what I'm looking for (I think).
New challenges: well, trying to get the data collection finished isn't going to be easy since firewalls, slow Internet and spring break are all or have been getting in the way but as they say, the show must go on.
Reflections: although I created an audience for my writers so that they would be motivated I don't think the audience has done their bit. By bit, I mean read the stories being published. There has also been a miscommunication regarding what was expected by the students from other schools but I think my students have been able to work through it.
And finally, the next step. I'm sifting through over 600 track changes today and categorizing them into 7 different categories. Once I've done that, I can start comparing it to my online survey data and if I can find the time I might even do some one-on-one interviews with a small number of students.

Saturday, March 15, 2008

my head is spinning

After 8 days with 23 students in Vietnam I'm home, rested and finally recovered (from whatever illness I had). I now see that David Wong is suggesting we finalize our data collection and begin analyzing it. Wish I was there already but I have a few more pieces to collect.
What have I learned so far; don't rely on others when you're trying to collect data. So far this has caused serious delays and the "product" hasn't been exactly what I was looking for. Having said that, I still think I can salvage what my students have produced and later this week I'll have them take the post wiki survey. I'm wondering if the data is going to support my assumptions or if there will be any surprises. I really just want honest answers from the students but I know that's hard to get. I'm also a little concerned because the project isn't really going to finish for another couple of weeks but I need data now so I don't know how that will effect the post surveys.
Oh well...upwards and onwards!

Tuesday, February 26, 2008

Starting to rethink...

In an attempt to get caught up on my readings for our lit review I've come across a few interesting things to think about. Firstly, in one article I read how students who use wikis are happy to add content but are reluctant to make changes. Without really knowing this, I explained to my test group that the wikis "belonged to them" so to speak. They each created a wiki and set up the admin password which I then gave to other classes. I stressed the point of ownership because I was hoping that "ownership" would be an intrinsic motivator. However, I'm now thinking that I've tainted the authenticity of the project. Wikis, unlike blogs, don't belong to any one individual; instead they are collaborative in nature. So haven't I taught the wrong message?
I haven't instructed the participating classes that "my" students are the owners so "they" shouldn't be tainted which means I'm still hopeful kids in Shanghai and Colorado go ahead and make whatever changes they want to the existing content. However, I wonder how my students will respond if and when they find their sweat and tears transformed into something else.
I may add this question to my post survey (i.e. did you accept changes made to your own work?). Also, I've just discovered that the Colorado kids are grade 4 students. I had originally hoped that the students would be closer to the age of the test group but perhaps this is a blessing. This way, it should provide a greater/more chances for my grade 7 students to "improve" the stories during the peer editing process, even if some of my students are EAL or below grade level.
Finally, one great idea I came across during my readings is actually suggested by Wikipedia. They suggest having students peer edit their articles for anything from spelling to content. This would have been easier to set up and easier to control (no reliance on other teachers) but could have provided me with similar data and come with a built in audience (of millions). Oh well, maybe next time. I may do this as a follow up to my primary research to see if the students do buy into making changes to Wikipedia and then see if their attitudes towards it as a main resource changes.

On a separate note: are our annotations on delicious enough or are we expected to write them up again for our final paper. Delicious doesn't allow us to write very much so I don't want to add/redo them all in the summer.