CCK09: How to look at a blogroom (3)

(Versione italiana)

Abstract, A kind of introduction

Beginning to look at numbers

After the kind of introduction it would be natural to give some details about methods and tools but  I prefer to further clarify what we are about first.

I’m reporting data relative to an online class of 21 students who were teachers of primary and secondary schools from all over Italy. The class was about using digital technologies in teaching activities and took part of a three-years graduation in an all-online university called Italian University Line based on the cooperation of five italian universities

and a National Agency devoted to the research and development in education: Agenzia Nazionale per lo Sviluppo dell’autonomia Scolastica .

This is the class where the blogroom method was most successful. The students reported this experience as a very rewarding one and all had the feeling to have learned a lot of things in a meaningful way. Furthermore, they felt to be engaged in a community.

The impression of having learned a lot of things is remarkable because the course was organized in a very loose way. I did not declare a “program” as a list of contents but I suggested a number of objectives, partly to be determined in function of the experiences and the needs of students. I claimed that contents would emerge from activities and that the whole course had to be thought of as a path, not necessarily the same path for all the students.

The case of this class was advantaged by the small number of students with respect to the majority of my classes which may reach more than 200 students. However there were also strong adverse factors, such as the busy life of adult students and the 100% online nature of the course, that made the experience significant.

The thesis I’m anticipating here is that, the perception of meaningfulness claimed by the students has to be advocated to the  emergence of a living community, very much akin to a community of practice, a context where the learning process is substantially improved.

The idea is therefore to use this class as a kind of reference to be compared with other classes, in order to understand the most significant factors affecting the learning experience.

The formal part of this course consisted in eight assignments where the students were required to write a short essay or to comment about a specific activity. Therefore, in the conventional perspective, each student was supposed to produce eight posts on its blog, meaning a total of 168 posts for all the students. Instead, the students, wrote 484 posts meaning that 316 posts have been written spontaneously. In other words, we can say that the students wrote about 23 posts each instead of eight.

One could wonder how much pertinent these extra 15 posts per student are. Here comes another reason I have chosen this class among many others. These students are in the range 30-50, therefore they usually have families duties and a job. That is to say that these are highly motivated people and, actually, almost all the posts concerned the topics of the course. Having said that, I do not mean that students are blamed for broadening the subjects of their posts, and very often their blogs are quite reach and colored, indeed. However, for what I’m trying to show here, it is good to know that the extra posts had a high probability of being “meaningful”.

So far, it appears that those 21 people did a great deal of work producing a 200% more of what it was expected. Even if this statement has some value and can be used for comparison with other classes, it is worthwhile to look at the results in more detail.

First of all, the average result may be a significant estimator of the global performance of a class but it is a very poor estimator of individual performances that are by no means homogeneous. Let us look at the distribution of number of posts per student. In reality, the figure shows the number of posts for each blog. In all cases this corresponds to the number of posts per student except in one case were two students shared one blog.  The point is the first one at the left. Keeping this exception in mind, in what follows I will refer to the number of posts per student.

f1_plot_IUL_esplicitaWe see that there are very large differences among the students. As a matter of fact, we found that the 484 posts were distributed among 143 “due posts” and 341 “extra posts”. This is due to the fact that the five students at the right wrote less then eight posts for a number of reasons: some had still to finish at the time of data uptake and some others needed a reduced number of credits for this course. Fifteen students wrote more than the minimum of eight posts, and about half wrote more the double of the required posts.

The 70% figure of “extra posts” (341 over 484) can be thought of as a measure of the community effect, in some way. In fact, it is well known that when a population is just free to undertake something or to contribute actively, the so called 1-9-90 rule holds true. That is over 100 people, one starts contributing, 9 follow the first one and the remaining 90 just look at what’s going on. These last people are the so called lurkers in the Internet. According to such a rule, the plot should be quite different, showing perhaps one or two outstanding contributors and the rest with just eight posts. The plot should therefore be completely flat except for a very narrow peak at the extreme left, instead of being almost triangular.

However, even if the distribution of posts gives an idea of the contributions exceeding the required minimum, we still miss the most important side, which is represented by comments exchanges among the students.  In order to get a visual feeling of such kind of activity it is useful to look at the sociogram of the blogroom.f1_gplot_IUL_esplicita

The sociogram shows the connections among the participants as well as their role. The existence of a line between two nodes means that at least one of the participants relative to that nodes made a comment to the other but it may also mean that multiple comments in both directions were made. Red nodes represents students belonging to the class, blue nodes students from other classes, green nodes educators external to the class that got involved in the blogroom, the light blue one is me, the teacher. The layout of the sociogram was determined by means of an algorithm called “Multidimensional Scaling (MDS)”, which is capable to discriminate somewhat the role of different actors in the network solely on the base the connections.

Actually, the MDS algorithm did a pretty nice job by placing the most active actors to the right and the less active ones towards the left side. However, the most relevant point is the amount of connections among the nodes and, in this respect, it is worthwhile to compare this sociogram with the extreme simulations I  showed in the introduction, were a conventional class and an almost all-connected classes were represented.

The star-like sociogram describing a conventional class is compatible with the plot of the number of posts. At most, we cold add arrows towards the teacher to say that the students produced a significant amount of contents and that this fact made a difference for the teacher.

This represents a conventional were the students produce such a lot of information that the teacher begins to notice it …

This diagram represents a conventional class were the students produced a lot of content, beyond what was required by the teacher.

We could call this a kind of high-performance class with highly performant students but there isn’t any “network effect”, everybody is just working harder, both the students and the teacher. Instead, in our blogroom a great deal of communication took place among the members.

The sociogram of our blogroom gives a spatial perception of the web of connections but it is interesting to go further by quantifying those connections. We can do this by plotting the number of comments that have been made or have been received and, eventually, some measures of the role played by different members in the network.

f2_plot_IUL_esplicitaThe first twenty points at the left represents students belonging to the class and are the same of the precedent plot about the number of posts. The nine points at the right side are relative to students belonging to other classes or educators that engaged spontaneously in the blogroom. The last point at the right is the teacher. The number of posts written by these last members (black line) is not plotted.

The black line corresponds exactly to that of the precedent plot. The difference is that here are reported data for all the members of the blogroom and not only the students, such as students not belonging to this class or educators that became interested in the activities of this blogroom. For these new members the number of posts in their blogs is not reported here so that the black line drops to zero towards right.

The red line shows the number of comments received from other members by each student. In the jargon of social network analysis this is the “indegree” value of a node. The green line shows the comments made to other members blogs by each student, that is the “outdegree” value. Indegree and outdegree are measures of  “centrality” of a node, that is the relative importance of that node in the network. In our case, a high indegree describes a prestigious actor and a high outdegree an outgoing one.

There is a rather loose correlation among the number of posts, the number of received comments and that of written comments. There are people that wrote quite a large number of posts but experienced few contacts with respect to others who wrote a comparable quantity of posts. Conversely, there are someone who preferred to comment others blog instead of writing on its own. Such particular behaviours are worthwhile of careful consideration because they may reveal interesting approaches as well as potential problems. It is difficult to follow all the interactions that are going on within the blogroom, thus this kind of representation may be useful detect relevant situations.

Even more interesting is the quantity plotted as a blue line: the so called betwenness, another measure of centrality which takes into account how much a node “is between” other nodes. The following picture taken from the article Centrality of Wikipedia (in this article you can find also the rigorous definition of betwenness centrality) gives an intuitive idea:

Color (from red=0 to blue=max) shows the node betweenness. Image downloaded from article <a href=

Color (from red=0 to blue=max) shows the node betweenness.

Together with the degree measures of centrality, betwenness is among the “classic” parameters of social network analysis since it was introduced in the seventies, however it is still considered a very effective measure of centrality. The difference with respect to the degree measures of centrality is that these are local, counting how many nodes are connected to a node, whereas betwenness measures how many paths among couple of nodes a node is intercepting, were the nodes may be also many steps apart.

That is, betwenness measures how much a node is connecting different parts of the network and not only neighbour nodes. Actually, I found that this centrality measure was very good at detecting the most active students.

A node with high betwenness acts as a sort of catalyst enabling the spread of  a 1-9-90 kind of participation towards a broader distribution. Thus, the high-betwenness nodes may play a crucial role for the blogroom life. We can think to that nodes as “key nodes” to which it is worthwhile to pay attention in order to facilitate the rise of the community.

It is not to say that those students associated to “key nodes” necessarily will get high grades. This may happen but it is not the point. It is to say that the teacher should spend some time in facilitating the action of “key nodes” because this may foster the health of the whole network improving, in turn, the participation of all its members.

I foresee to use betwenness in much larger classes, where it is difficult to become aware of all potential “key nodes” in time. I would like to detect those nodes at an early stage so as to exploit their potential before the class is going to finish.

The instrumentarium of social network analysis is extremely reach and with the simple examples I have made we have only scratched the set of possibilities. Of course, abundance of possibilities does not mean certainty of success but it is worthwhile to explore them provided we stick to this objective: devising methods to nourish the community in the blogroom giving rise to an experience of meaningfulness in its members.

In successive posts I will tell about other ways to look at blogrooms and as well as about the methods I’m applying.

CCK09: How to look at a blogroom (1)

Versione in italiano

Abstract

A kind of introduction

Why I’m doing this work?

I have been applying the blogroom method during the past four semesters with about 800 students out of a total of about 1400 distributed in 20 different curricula, some of the Faculty of Medicine and some of the Faculty of Education Science.

I have being applying this method when teaching digital literacy or related subjects, so far.

Short description

To describe the method in a nutshell, there are only a couple of conventional lessons at the beginning of the course, where the students are told the basics of the method. Then, the teacher is available for some weeks in a computer room to help students when needed, to engage in discussions or to make seminars.

In the computer room the students are encouraged to help each other. The rest of the course life take place within the blog community. The teacher gives assignments in his or her blog and the students are supposed to write their essays as posts in their own blogs.

The  assignments are not intended to “cover” a range of topics or to assess skills directly but are conceived as stimula to explore autonomously. We may say that assignments are chosen just to address some broad relevant topics.

In online courses where it is impossible to organize conventional lessons and other kind of meetings, the blogroom is supported with weekly virtual meetings.

Peculiarities of a blogroom

Besides the rough participation numbers and the distribution of grades, the teacher is left with a tangle of impressions and feelings, a very strong trace even if a subjective one.

Nonetheless, from such tangle of impressions some clear points emerge regularly:

  • Something very different happens when the blogroom method “works”.
  • The success of the method is very much peculiar to the curriculum. Even the degree of a priori acceptation – that is the number of students that decide to try the new method, since they have the freedom to choose between the new and the conventional approach – is variable, ranging from 10-20% to almost 100% depending on the curriculum.
  • The most striking feature of a working blogroom is the emergence of an emotional component: a significant number of students get involved in a manner that is quite unusual in a conventional class.
  • In a working blogroom a significant proportion of the students would like to continue and, as a matter of fact, the blogroom survives the term of the course.

In short, the blogroom appears to be a living being.

The problem

In the classroom the teacher follows each student separately and usually, the relationships among classmates are kept to a minimum.

In a conventional classroom information flows almost only from the teacher to the students.
In a conventional classroom information flows almost only from the teacher to the students.

On the contrary, in the blogroom, students are encouraged to engage in discussions with classmates and other people and not necessarily about the taught topics.

In a blogroom there may be a rich exchange of information giving rise to a true network. The picture shows a simulation of an extreme situation where everyone is communicating with almost everybody.
In a blogroom there may be a rich exchange of information giving rise to a true network. The picture shows a simulation of an extreme situation where everyone is communicating with almost everybody.

When students get the message, the blogroom comes to life in the shape of a network that is quite difficult to follow since a living network is a chaotic entity.

Of course, I remember well a lot of posts, comments and whole threads of discussions. I know very well many students and often I get a rather clear idea of their personalities. However, for sure a great deal of threads get lost and in my perceptions, the relative proportions may be distorted by my own feelings or preferences.

The idea

However, by its nature, the Internet has memory or, perhaps, is a kind of memory. It hosts life forms and often their traces impressed in the time course can be recovered. This happens to the blogroom, too. All the posts and the comment are retrievable from the feed aggregator and they can be analyzed by means of mathematical and graphical tools.

The idea is to try to construct ways to look at the blogroom in its entirety from different perspectives and having the possibility to focus on specific aspects.

We could put it in the following way. The blogroom is a living entity but its multidimensional nature may be quite complex and therefore we need instruments that allow us to look at it in a reliable way.

I believe that the idea could be interesting being aware that 1) the subjective perception of the teacher remain fundamental, 2) mathematical devices are not magic.

PS: I will be very grateful to anyone willing to tell me about similar works or papers on this subject.

Sociograms have been made with Stanet.

CCK09: Connectivism and Connective Knowledge

(Versione italiana)

Last year I participated to the online course Connectivism and Connective Knowledge given by George Siemens and Stephen Downes. It was a great experience that influenced deeply my practices. It is a good new that they will deliver another version in the fall of this year.

One of the interesting features of these courses is that everyone is free to participate in its own way. This year it will not possible for me to attend the course as I did last year. Nevertheless, I subscribed with the intention of  posting during the course about a work I’m doing that I believe is related to some of the topics  that will be faced in this new version. I will try to listen to those that share similar interests in CCK09.

In this first post I’m going to outline this work.

The objective is to investigate the potential of web 2 technologies to improve the learning experience in a variety of graduate and post graduate courses. Basically, with the method I’m investigating, the teacher tries to facilitate the personal involvement and the practice of the students by keeping to a minimum its own interventions. From the technical point of view, the teaching method is based on the use of blogs and feed syndacation. Both the students and teachers use the blogs to write assignments, to pose questions, to comment and to collaborate. More details are available in this paper (pdf).

My thesis is that by means of the blog community and a sensible conduit of the teacher it is possible to give life to a phenomenon akin to what Etienne Wenger described as a community of practice (CoP), where the feeling of common objectives, the active collaboration among participants and the development of a set of common practices, substantially improve the process of meaning creation and, consequently, the learning experience. However, in my perspective the role of the teacher should not be that of controlling and managing that community as it is often intended when talking about CoPs. Instead, I see this community as something that should grow by itself, free to establish connections with resources, people, organizations and networks that are external to the class environment, much in the sense of connectivism as it has been formulated by George Siemens and Stephen Downes.

Thus, the class is the place where I welcome my students but then I try to bring them “outside” through what I’m calling the “blogroom”. The blogroom is a living community and the teacher has to take care of it as it is common with every newborn form of life. When you are taking care of a living being – it could be a newborn infant  as well as a grove or anything else – the most important thing is to learn to observe it before doing anything.

The blogroom community is a living being because it is composed of humans but it is also a living being in its whole. The teacher should be able to see this creature being aware that its well being is of great importance to improve substantially the learning experience of its components.

The main objective of this work is to explore methods to observe this community, supporting, but not replacing, the complex subjective impressions and feelings of the teacher. Since the life of the blogroom is trackable in all its details, the idea is to use methods of the social network analysis to extract relevant information from its traces.

The method is based on a set of web services and open source tools that allow one to extract the history of the blog community and to perform statistical and graphical network analysis on such data. The tools are 1) Google Reader for feed aggregation, 2) Google Docs for management of students data, 3) a set of Ruby packages to automatically browse the internet and exctract data from web services, 4) the Statnet package of the R environment for social network analysis and, finally, 5) some software I’m writing in Ruby myself to glue all together.

In this method, a variety of social network analysis tools are used to evaluate the part of students activities beyond the minimum trivial level constituted of a standard sequence of assignments. These evaluations may be done both on longitudinal studies as well as to compare different students populations. Conventional measures of networks as well as recent network modelling methods based on exponential-family random graph models (ERGM) are used.

This is a no cost project since all these web sevices, software tools and software languages are free and I will use them as long as they will remain free.

During the next months I will posts on specific aspects of this work.

%d blogger hanno fatto clic su Mi Piace per questo: