📚 Want to Read: How to Be Sick by Toni Bernhard
02/28/2020 Process Memo: Beginning sustained, systematic observation
I began my sustained, systematic observation today by gathering my initial resources for this phase.
First, on my Dissertation Trello board in my Sustained, Systematic Observation list, I created a card called “Collect initial resources.”
On this card, I created a checklist and including the following types of sources to use to identify resources:
LIS sources
- Those I mentioned in my proposal (book & articles)
- Those referenced in Cosplay in Libraries (henceforth referred to as Kroski 2015) (specifically, LI Pop Culture Con)
Cosplay sources
- Convention websites to review for guest or cosplay group names
- Groups mentioned in Kroski 2015, such as Star Wars groups the 501st & Rebel legions
- Sources identified by Googling “Marvel cosplayers” and browsing the first 10 pages of results. Kroski refers to her own cosplay “origin story” as being when she participated in a call for Marvel cosplayers for an episode of Cake Boss. This mention is why I Googled Marvel cosplayers.
Next, I began a close reading of Kroski 2015 to look for resources she suggests/mentions. This includes specific lists of tutorials related to particular techniques, books she mentions, apps, and references in her endnotes that are cosplay resources such as blog posts. I am flagging these with Post-it flags and will enter them into a spreadsheet before beginning using my observation protocol.
I will also need to perform the observation protocol on Kroski 2015 itself.
Just skimmed Parenting Doesn’t Matter, the main premise of which is that according to science, your parenting is unlikely to be the thing that messes up your kid. It reminded me of an argument I hear sometimes for a variety of possible parenting choices that makes me grouchy: “I [insert whatever here] and I turned out okay.” For example, “I was bullied in elementary school and I turned out okay.”
This rhetoric seems to me to rely on the assumption that childhood experiences only matter to the extent that they impact our adult lives. But I take issue with this assumption.
Children are not raw material waiting to be formed into real people when they reach adulthood. They are full-on human beings, with emotions and thought processes, and they deserve to have positive experiences NOW, not just when they are adults.
So when I have the opportunity to make life better for my kid, I don’t ask myself whether I turned out okay in spite of not having the experience I’m considering. I ask myself how it will impact his life NOW.
What am I opening? (Dissertating in the Open)
I’ve been doing some reading this week on what it means to dissertate in the open, and as there are many different ways to do it, I thought I would talk quickly about my plans moving forward.
First, here are some of the sources informing my ideas:
- Dissertating in the Open by Laura Gogia
- Granularities of the Open Dissertation by Laura Gogia
- The Integration of Web Culture into Higher Education by Laura Gogia
- Opening the Dissertation by Bonnie Stewart
- Shifting my research question by Rebecca J. Hogue
- The Open Dissertation by Maha Bali
Laura Gogia’s visual article and post on granularities sum it up best. I can open up my dissertation process and/or my dissertation content, using a variety of tools. So far, I’ve done a combination of both: I’ve offered insight into the process and shared documents such as my literature review, prospectus, and proposal.
For now, I’m going to focus on sharing process. I will come back around to content, especially as I want to share my research with cosplayers, but my primary audience right now is other researchers - especially doctoral students and early career researchers.
To that end, I will be blogging my process memos. In the course of working on my PhD, I’ve discovered it’s far too easy to forget how we got to a certain point, so I’m going to keep daily process memos about the work I did that day. I’ll probably be a day behind in posting them, since I’ll write them at the end of my workday. So you’ll see today’s process memo on Monday.
Have a lovely weekend!
Dissertating in the Open: Beginning to Set Up a Data Collection Structure
I’ve been trying to establish my data collection/analysis workflow and I’m running into the age-old problem with qualitative research: you don’t really know what you need until you’re in the middle of it.
One of the things I heard repeatedly from professors was that the difference between quantitative and qualitative research wasn’t how much work you would do, but at which end of the process you would do it. Quantitative research requires a lot of up-front work, designing surveys or experiments, etc. , but analysis can go pretty quickly as long as you already know which statistical tests you need. Qualitative research requires a lot of work in the analysis stage, and the beginning of the design process is a little more free-flowing and improvisational.
(She said, thinking about her detailed interview and observation protocols and meticulous research design…)
I’m the kind of person who likes to have structures in place ahead of time so that when I’m in a thing I can just do it. If I don’t get those structures in place, I can be a bit of a mess. For example - life example, not work example - if I don’t do all of my pill-sorting at the beginning of the week, there is an almost 0% chance that I will take anything besides my prescription medications. (I take 24 pills a day, when prescriptions and supplements are added together.)
So I wanted to have a data collection structure in place, so that my data would not become a mess.
I realized, though, that creating an elaborate data collection structure was a form of productive procrastination. After all of the complaining I’ve done about being ready to start on my own research, though, I really ought to get down to it.
I settled on only setting up the data collection structure for the first phase of my research, sustained, systematic observation. I gave myself permission to work exclusively on that for a couple of weeks before I design the next set of structures.
I’m going to start on that tomorrow, and my plan is to write a blog post about that process in hopes of helping future scholars who might use connective and affinity space ethnography.
Dissertating in the Open: Writing and Defending the Dissertation Proposal
I successfully defended my dissertation proposal on February 3, 2020.
I have one huge piece of advice for writing your dissertation proposal: buy or borrow Research Design: Qualitative, Quantitative, and Mixed Methods Approaches by John W. Creswell and J. David Creswell, and do what it says. It will guide you through the proposal-writing process down to the sentence level. It is expensive. It is worth it. It is the most useful graduate school textbook I’ve ever bought.
It’s possible you’ll discover at this point that you haven’t made as many decisions about your methods as you thought you had. That’s fine. Make them now.
For example, I realized that I had no idea where online I wanted to do my observation. This stalled me out for a few days, until I remembered that figuring that out was the whole point of the sustained, systematic observation part of affinity space ethnography (PDF). So I wrote about how I didn’t know that yet, about how my design is emergent, and about how I imagined that observation might play out.
In November and December 2019, I wrote the first draft of my dissertation proposal. I submitted it to my committee ahead of my comps, so they were able to quickly peruse it and offer me some feedback during the oral exam.
At first, some of the feedback overwhelmed me. Dr. Casey Rawson suggested that rather than a wide-scale ethnographic approach, I might take a case study approach, following just a few cosplayers through their process and attending to their information practices. This was an intriguing possibility, but the logistics overwhelmed me, as I’d have to know a few cosplayers well enough that they would allow me to actually physically be with them throughout their process, plus I would have to manage the time (i.e., childcare) to actually be with them. I decided that this was a cool idea, but it was a different study than my dissertation, so I ended up putting it in my suggestions for future research in the second draft of my dissertation proposal. Now I had a research program, not just one study.
I sent this second draft to my committee right before the winter holidays, starting the clock on the 30 days I was required to give them with the proposal before the proposal defense. We scheduled the defense for February 3, and I spent January creating my proposal defense slides. (As always, if you are a cosplayer whose photo I used and you would like it removed, please let me know and I’ll oblige ASAP.)
As I was working on the slides, I read through the proposal and asked myself what questions I would ask if I were a committee member, and then set out to answer them in the slides.
First, I realized that there were some terms I mentioned in the proposal and had defined in the literature review, but that probably needed to be defined again at the proposal defense:
- Collective intelligence
- Information literacy
- Affinity space
- Blended affinity space
- Constellation of information
Then, I realized that my research methods were still not as detailed as I would like. I wanted to be able to show the committee what my research would actually look like, in practice. I remembered that for my theory development class, I had created a grounded theory proposal and included sample data that I had actually coded. I decided to do something similar for this presentation.
First, I demonstrated what the sustained, systematic observation would look like, using a librarian-recommended cosplay resource as my starting point. I created a specific observation protocol for this stage based on the affinity space ethnography literature, and applied that observation protocol to the resource. I evaluated that resource to determine if it was information-rich, and it was. I followed links out from it to other resources, evaluating them as well. I determined that the original resource was information-rich, and showed what it would look like to pull down data (in this case, YouTube comments) and code them using both my information literacy and collective intelligence coding schemes.
I put all of this stuff in my slides:
(I’ll say it again: if you are a cosplayer whose photo I used and you would like it removed, please let me know and I’ll oblige ASAP.)
The proposal defense went really well. I felt very prepared, having done all of this. My committee members said it was a thorough proposal and appreciated the demonstration of the methods. They also gave me several helpful suggestions for revising the proposal further before I submitted it to the Institutional Review Board. I submitted my final dissertation proposal to the review board on February 5, and a copy of it went to the SILS library, as well.
After one round of revisions and one correction of a typo, my IRB application was approved and determined exempt from further review. Time to get to work!
Just lost a really long post about my dissertation proposal and proposal defense because, like a fool, I didn’t save the draft and because I’m sleep-deprived and hormone-addled, I closed the tab.
I’ll try to recreate it later. Blergh.
So my dissertation study was determined exempt from further review so I guess I have to actually, you know, collect data now. (Still planning to spend at least tomorrow putting together organizational systems and a data management plan.)
Starting to create a data collection/analysis workflow... Not there yet.
Most of my blogging has been micro this month, which is appropriate since I’m hosting my blog on micro.blog now. It has really made a difference in my comfort level and ease-of-blogging; much lighter weight than WordPress. I don’t feel like I have to have a 1000+ word essay to bother posting (obviously).
I do want to get back into longer form, though. The reason I haven’t this month is because at the beginning of the month I was getting ready for my dissertation proposal defense. As soon as I passed that, I had to write my Institutional Review Board application. Once that was done, I had to write an application for a dissertation completion fellowship. And then when that was done, the IRB application came back with 7 revisions I needed to make. I did that this morning.
I didn’t think all this stuff would take 3 weeks. I thought it would be done in the first week of the month, that I’d sail through IRB (more the fool me!), and then be doing data collection already. I also thought that during that brief wait from IRB application to IRB approval (again, haha, brief, apparently they’re moving very slowly lately), I’d come up with a beautiful data collection and analysis workflow.
Let me tell you what. Based on my quick Googling and visiting my favorite resources on academic writing (okay, my one favorite, Raul Pacheco-Vega’s blog) and my lit review, people really don’t want to share the nitty gritty details of their qual data collection workflow/process. Usually, when I bump up against something like this, my instinct is to then be radically open with my own process and create a resource other people can use so they don’t have this problem. (See: the Intellectual Freedom Toolkit I created with W. when there was a book challenge at the school library where I worked.)
But, well, for now, I’m at a loss as to where to start. I went back to my syllabi for what we call babydocs at SILS, and it had some good stuff for navigating the early part of a PhD, but not as much project management lit as I would have liked. I’ll dig into my qual methods course syllabi next, but I suspect they won’t offer much either.
Everybody wants to tell you: 1. why a given research design is appropriate 2. big picture how to do those methods And of course those are SUPER IMPORTANT!
But whoever is writing about like… Where they put their memos, and stuff - how they organize their workday when they’re doing fieldwork - esp. virtual fieldwork - well, I haven’t found those people yet. I’m sure someone must be writing about it. Not sure how much time I’ll spend before developing my own systems.
Here’s what I’ve got so far:
- I’ll probably take field notes in my personal physical notebook, originally.
- Then I’ll transcribe those into MaxQDA I guess?
- I’ll use a digital recorder to record interviews and panels, then import and transcribe those in MaxQDA, too.
- MaxQDA has space for coding memos, but I don’t know if there’s good spots in there for reflective memos, so I need to check into that. (Also I’m thoroughly pissed at myself that I can’t find my favorite qual research textbooks - Goodall’s Writing the New Ethnography and Coffey and Atkinson’s Making Sense of Qualitative Data. I might need to do some deep decluttering in the next week or so to try to track them down.) If MaxQDA doesn’t have a good spot for coding memos, I guess I’ll write reflective memos in… I don’t know. Word? I might do it in Scrivener though.
- I’m definitely going to read some advice on dissertating with Scrivener.
- I think I can pull webpages into MaxQDA, too, so that will be helpful.
Anyway. None of this process is helped by an extreme lack of sleep and hormones running wild, so. Might just call today a win with the whole IRB resubmission thing and cut myself a break.
Anyway, soon, I’m planning to write a proper Dissertating in the Open post about writing and defending your dissertation proposal, so stay tuned!
📚 Want to read: Wheat Belly by William Davis, MD