International Women’s Day, Manchester Central Reference Library, March 2020

It was only 3 weeks ago, but it seems like another life-time already – a reminder of how the arrival of a new, untreatable virus can change the world.

The Reanimating data team travelled one last time to Manchester on the evening of March 6th in order to prepare for our finale event at the Library. We had sent ahead some of the physical documentation of the project to be housed in the vitrines of the archives plus section of the library: the original WRAP questionnaires, pamphlets and some data; feminist youth work posters and magazines from 1989 taken from the Feminist Webs collection and examples from our different youth work projects in Manchester which during the last 9 months have ‘reanimated’ the WRAP data. It was exciting to see these materials behind glass and preserved as history.

We then went upstairs to get our meeting room ready – spreading banners, craft materials, and ephemera from 1989 around the room. We had a playlist with some musical highlights and we waited to see who would turn up.

Before long we had a room full to bursting. Young people from all the different youth groups were there. Our critical friends. The original researchers and new generation researchers working with the materials. Youth workers and sexual health workers from across the city and the lifecourse. We all got to know each other by playing human bingo – looking for members of the original research team, a youth worker, a member of a youth projects.

Niamh Moore opened the workshop by welcoming participants and explaining how the old WRAP project links to the new RAD project. We began the day by sharing the film that Sue Reddish and Jim Dalziel have made explaining what it means to ‘reanimate data’ and capturing the different youth work projects in Manchester. Huge thanks to Sue and Jim for documenting the work and helping us make sense of it all.

After this young people from each of the projects then had the opportunity of talking about their experience of the project – sharing what they had done with the data, what they learned and what surprised them. We started with Emma Okomoh from the Levenshulme Youth Project who showed and talked about the short animated film that she had made working with one of the WRAP interviews, noting how important it is to find someone you can identify with in the material as a starting point for connection. Emma had been supported in this by Paula Carley and Siobhan O’Connor and Marianna Vareli, the lead youth worker for the Levenshulme girls group.

Next youth worker and artist Hebe Phillips and young people from one of the Proud Trust ‘s LGBT young women’s groups talked about their work with the ‘purple pamphlets’ and how they had used music to try and get a taste of the 1980s. The group were uncertain whether any of the original interviewees had identified as lesbian or bisexual and in their work on the project had tried to read between the lines of the interviews. They also had a go at asking some of the questions posed on the interviews of themselves as a way of filling the gap. This group’s creative work developed into the creation of self portrait squares that capture their identities as this is what they came to realise was happening in the original interviews as each WRAP participant was invited to tell her story. The making of squares was opened up to participants on the day and in the library after the event. These squares will be stitched together by textile artist and youth worker Hebe Phillips to make a banner that celebrates the voices of young women and takes their stories into the future.

The best thing about the data for this group was the lack of subtlety of the interviews making it possible to talk explicitly about sexual practise and feelings. What surprised one of the young women, Bethan, was how little has changed in terms of formal sex education despite big shifts within the culture towards openness. Answering the question of how they had learned about sex the young women at the Proud trust were surprised to find that their answers were very close to those of young women in Manchester thirty years earlier.

Listen to some of the Proud Trust group talking about what the reanimating data project was like for them in their own words.

Young people from the Women’s Theatre Society talked about how they had worked with the interview material since September, using drama exercises and bringing it to life in different ways and in the process creating a show that included skits, extracts, and personal testimonies inspired by reading the stories of others. Again, the directness of the original questions were valued, even if they had been surprising and transgressive at the start. By working with these direct questions the group found themselves having conversations that they would not otherwise have had, making themselves vulnerable and naming experiences in such a way that they were able to identify with each other and with an audience. The positive reception that the show received had taken them aback, being so wrapped up in what the process has given them the young women were surprised and moved to realise that this process would continue with the audience who also identified with and responded to the authenticity of the material, feeling that they had been understood through the story of another.

Hear from some of the Women’s Theatre Society in their own words (and bear with the bad audio – it gets better!)

Lecturer and former youth worker Jayne Mugglestone from Manchester Metropolitan University talked next about working with her final year Early years and Childhood studies students to explore the WRAP data. Jayne reflected on how the creative and participatory methods used to work with the data had transformed the students’ understandings of research but also how she had been reminded herself about what was possible in a university classroom setting. From a predominantly South Asian backgrounds and living in Greater Manchester the young women Jayne works with had been fascinated both by the continuities over the thirty years (nothing has changed) but also positive changes such as the way social media facilitates community for those who might otherwise be isolated. The experience of being in a community of women, asking difficult questions about sex that spanned thirty years was a powerful experience for the group – opening up their understanding of well-being and the role of women’s spaces of inquiry in making this important work happen.

Next up was Claire Fox Reader in Educational Psychology at MMU and Charlotte Bagnall, PhD student and associate lecturer – who shared with the audience how they had worked with BSc Educational Psychology students to use two transcripts from the WRAP archive to teach qualitative research methods, including the coding and interpretation of qualitative data. The richness of the material meant that students could focus on just three pages each from two transcripts generating rich findings about the inadequacy of school sex education and the workings of an informal sexual culture characterised by a sexual double standard and governance by sexual reputation. Here is their blog about their experience of using the archive as a teaching resource in higher education(and how to make methods teaching lively, ‘experience-near’ and feminist!)

Ali Ronan who acted as the coordinator for the youth work projects thanked all the projects and shared her view that the work has only just begun.

The final part of the event involved sharing the archive that has now been formally published in the University of Sussex repository where it will be preserved. Rachel presented this and thanked Rosie Gahnstrom for the huge amount of work that she has been doing in anonymising and cataloguing the data set. Janet Holland and Robert Albury were also thanked for the tricky and time consuming work of freeing the original data from obsolete media and machines. The archive will also be available through our Omeka platform (FAYS) where we will be creating ‘exhibitions’ using material we have collected and generated over the course of the project. This will give potential users a taste of how the WRAP archive can be used and explored and will help build a community around the archive.

The archive has been reverse engineered, and Manchester has been put back into the material and made visible. The archive will also remain in Manchester and people were encouraged to use it. 

Over the course of the project we have been exploring different versions of sharing and exploring and animating the archive, including the kinds of youth work and creative practice shared at this event. To conclude the event Rachel shared some initial reflections from another experiment we have been working on – the feminist chatbot. This has been developed in collaboration with a group of women learning to code at the University of Sussex as we explore new ways of asking questions directly of the archive. We introduced the room to the bot and asked everybody to write down one question they would like to ask of the archive. We tried one and the bot couldn’t answer, but we’ve kept their questions to help us understand what potential archive users might want a feminist chat bot to do and what future work might be done with the WRAP archive.

At this point the group went downstairs to the archives section of the library which was buzzing with people who had come for the International Women’s Day celebrations. Members of the public were invited to make their own felt square using material from the archive, an invitation that they responded to enthusiastically.

A huge thank you goes to Ester McGeeney who managed the reanimating work from a distance and planned and lead the day. An exhausting, exhilarating ending for an extraordinary project.

Feminist chatbot 2: front /back, questions/ answers; now/then

Rachel Thomson

This workshop (second in the series) focused our attention on the relationship between the front end of the bot (written in Java and creating the interface with the user, designed to hear and decipher their question) and the back end of the bot – the potential answers to the question that takes the form of a data base or archive (and created in python code within a flask container). Workshop leader Suze Shardlow encouraged us to think through all the stages that might be involved in a simple question and answer cycle – each action requiring construction. Here we see one attempt to map the stages involved.

Suze encouraged us to juxtapose a typical commercial application for a chat bot (for example online Pizza ordering) and our attempt to use a chat bot as an interface for an archive made up of interviews conducted in a conversational style. So for example, the question ‘how can I help you’ on a pizza order site is limited in its potential answers to the menu offered by the restaurant. The questions that we might ask the WRAP archive and the kinds of answers that could be evoked are not so constrained.  So how do we begin the process of focusing down the kinds of questions that can be asked and the potential answers that can be given?

We could offer our users a limited set of FAQs to choose between. This would make things easier in the short-term, but it would also mean that we miss out on discovering what it is that contemporary audiences want to ask. It would also derail our desire to mimic conversation – to create the feeling that the user is talking directly to Mary and to the past that was so powerful in the first workshop when we first met Mary.

Thinking about potential questions also prompted a discussion about what was feminist about our bot. Would she for example refuse to ask certain questions, suggest that people reflect a bit more or simply suggest that they ‘google’ that one. How censorious and how curious would our chat bot-be?

We also had to think through the relationship between the questions asked through our chat-bot today (which would be relayed to the archive) and the questions asked thirty years ago by researchers. At one level this is an entirely practical matter – perhaps we could simply piggy-back on the original questions, re-using these to call up original answers. The problem with this strategy is that the interviews were highly conversational in style – it can be hard to isolate a single question and answer as we see below in this extract from an interview with Melanie:

Q: How about ways to stop it being sexually transmitted? Do you know how you can not catch it, I mean what safe sex is?
A: Oh yes, using a condom.
Q: Is there anything else that would count as safe sex other than using a condom?
A: No.
Q: Right, I’m not testing you. I’m generally trying to find out what type of things people know.
A: I think this is terrible actually, I really haven’t thought about it and I’m realising that I know so little about it’
Q: For instance would something like oral sex, would you know if it had any risk attached to it or not?
A: Well no I wouldn’t, but I would imagine that I would say it has.
Q: Right. So you’ve got a general idea of how it’s …
A: I’m assuming it has, is that right?

So, if we don’t piggy-back on the old questions, do we simply ignore them? In relation to the above example we might train the chat bot to hear a question that includes the word ‘safe sex’ – how do you understand safe sex? Do you practice safe sex? And we might select this particular extract from Melanie as an answer ‘I think this is terrible actually, I really haven’t thought about it and I’m realising that I know so little about it’. This allows for a direct relationship with the contemporary questioner and Melanie. Alternatively, the original researcher could be treated as an integral part of the conversation. Following this logic our contemporary user might ask a question of the archive along the lines of ‘how was safer sex talked about in the interviews’ – allowing an extract of conversation to count as an answer.

For the members of the workshop, this question linked directly to our explorations of who/ where/ how the feminism of the project sits and the relationship between feminism then (as captured in the approach of feminist researchers), feminism now (as captured by our decisions as to how to engineer the relationship between the front and back end of the bot) but also feminism (?) of the user whose questions have the potential to open the archive up in new ways.

And this takes us to the final key area of our discussion during the workshop which was the relationship between a rule-based design for training our bot to make links between questions and potential answers and a machine learning approach  (Artificial Intelligence) approach where the bot works directly with the language of the data set rather than the way that it is coded – having been already trained for the task using rule based approaches that are no longer visible to us. In thinking through these alternative strategies we considered the primary role of the chat-bot as a user-facing tool that would helps people access the archive – rather than a tool for analysis of the archive. In terms of the ambitions of the FACT workshop and the RAD project our aims are relatively modest – to collaboratively build a simple chat-bot and to gain an understanding of the labour involved in this process (FACT), and to experiment with ways of reanimating the data set to encourage new users and to learn about the questions they may have (RAD).

As with the previous workshop we also learned about the painstaking process of coding and that things take much longer than you might think – both in building the front end of the chat-bot and in preparing the data for the back-end. Our immediate plan is to mark up 5 interviews with around 10 key words as a first stage of creating a relationship between possible questions and potential replies. On Saturday March 7th we are introducing our pilot version of the chat-bot to her first audience at an International Women’s Day event at Manchester Central Reference Library where we will showcase some of the  ‘reanimation experiments’ that have been part of the RAD project.

A feminist chat bot?

Rachel Thomson

Our latest experiment for the Reanimating Data project is the creation of a chat-bot that forms the interface between the WRAP archive and users. The project is a collaboration with FACT// Network, Feminist Approaches to Computational Technology, and part of their CHASE funded programme of work which promotes feminist expertise in coding. The project is lead by Cecile Chevalier and Sharon Webb of the University of Sussex, and the first in a series of workshops was lead by Suze Shardlow who is co-director of Women Who Code London. Over the course of three sessions, we are working together to complete a project whilst learning and applying the fundamentals of both the Python and JavaScript programming languages.

So what is a chat-bot, and can they be a feminist? Most of us only have experience of chat-bots providing help in our online banking, drawing on an archive of possible answers trained by AI to match up with recognised questions. Cecile and Sharon explain: ‘Our feminist approach to computation means that we are not just coding for coding’s sake, we are interested in critiquing both the means of production (e.g. the process of making) and the outcomes (e.g. the software/object created). This also means that the data and the context of our coding work are important. Therefore, we are delighted to announce that we have teamed up with the Reanimating Data Project to create a chat-bot that speaks to the Women’s Risk and Aids Project archive (WRAP).’

So Friday was the first in the series of workshops and Suze worked patiently with a diverse group of participants whose expertise ranged from ‘complete novice’ to ‘rusty’. We learned about the difference between the ‘front’ and ‘back-end’ of applications and gained a sense of the painstaking work that goes into to creating the kinds of interfaces and functionalities that we take for granted. As part of setting up the task I brought along some of the original pamphlets from the study. However it was when we connected our coding to dummy data from the archive that we got a taste of what it might mean to create an interface. The chat bot asked us who we wanted to talk with in the archive. We said ‘Mary’. And then Mary appeared, ready to answer our questions: a voice from the past meeting us in the present. At this point there was an avalanche of questions about the original study, how old were they now, were they even alive? What had the original consents entailed and how it might be possible to translate them into a new media landscape. The conversation moved into our own teenage experiences, questions about what had changed in intimate relations over 30 years and how much we had in common as women from different backgrounds and cultures. We also began to understand the power of the chat-bot as a tool for a new kind of data analysis: what kinds of questions would she be asked, how would these shape her approach to the archived material. Even though we knew “Mary” was a sequence of Python statements there was still an overwhelming emotional response to “Mary” speaking back – especially for those, like myself and Sharon, who have been working on the data for the last year. 

Our plan is to work towards building a chat-bot over the next two months and for this to be part of our presentation of the fruits of the Reanimating Data Project in  Manchester on March 7th. We don’t know what this will look like, we expect that Suze will need to finish it off for us. We are also unsure whether the chat-bot-and-archive will need supervision – probably. We know that there are difficult stories in this archive, including stories of bad and non-consensual sex, or loneliness and self-doubt. These are also part of the historical record and while we have made sure that the interviews are anonymous we are unwilling to censor or erase the substantive content. So we just need to think carefully about the situations in which the chat-bot is used and to understand a bit more about the black box of AI that we evoke when we say the bot is trained with the data. In what ways might we need to intervene in order to encourage her to be a feminist-bot?

Yet again, the project of reanimation has brought up vital contemporary questions.  Starting with an archive is an exciting prospect, opening up many opportunities for discovery, collaboration and play. I am very grateful to Sharon and Cecile for agreeing to work with the WRAP project. Not only are we developing some of the skills and awareness necessary for understanding how to make things in a digital age, we are also bringing together tools and materials in new ways that open up the possibilities of what a (feminist) chat-bot might be. I am especially intrigued to fund out what people want to ask the past as well as to discover if these questions reveal aspects of the archive that have as yet been occluded.