Scaling the Drupal Community - Notes and Reflections

The sparsely-attended 'Scaling the Drupal Community' session, led by webchick and heyrocker, was one of the few sessions I've attended at DrupalCon Chicago that held my interest throughout. And, since a few people on IRC asked me to post my session notes, I thought I'd do so and put them up on the Planet.

If you, like me, thought there were too many awesome sessions during this timeslot that you decided to go to another one, then this post is for you—I believe that anyone invested in Drupal's future stands to gain something from reflecting on what webchick said at the session.

Now, on to the notes. I will give a summary of a statement by webchick, then my reflection (kind of a Q&A format):

On 'Drupal Answers' vs. a drupal.org solution for Drupal Support

Drupal Answers is a new Stack Exchange site for answering Drupal questions, and it's in public beta right now. The site is hosted off the 'drupal.org' family of sites, and has a few hundred users so far...

Webchick: Webchick basically stated that she's leaning towards what we already have (with slight adjustments). She mentioned that there's no good answer for the question of motivating people to help support drupal newbies without incentives (a karma or reputation system).

Also, she said that moving the support away from drupal.org is potentially very dangerous; this could lead the 'newbie' community away from the 'expert' community (which tends to discuss things in drupal.org issue queues. Right now, 'newbies' typically hang around in drupal.org forums, and 'experts' typically stick to their trackers and issue queues.

She said that right now, to form an idea of a particular drupal.org user's reputation, you can visit their drupal.org profile page and see: number of commits, commit log, user id number (lower is better!)... basically, you judge the user based on the user's actions/work.

If we use an incentive system whereby you can compare two users based on karma, points, or badges, then (especially for developers—who lean towards being gamers) things turn into a culture of competition (rather than collaboration)—everybody "plays to win".

It boils to this: We have to ask ourselves, "What is the cultural impact of using the Stack Exchange based site instead of drupal.org forums or another internal solution?" — don't just think "Well, it's a better tool."

My Thoughts: As was mentioned in IRC during the talk, some good background material on our current situation comes from the SE founder himself, Jeff Atwood; check out his "Code: It's Trivial" post.

I think it's very important we move on this issue asap, before we see major fragmentation in the Drupal support arena. I think that new users may have a tendency to move to Stack Exchange to seek help, especially after they post to the drupal.org forum and receive no replies after a few days.

The question I would pose is: How do we incentivize user support? How do we make people want to help newbies in the Drupal community? The job doesn't reward much, except for personal satisfaction... do we use a karma/points system? Badges? I don't know...

On 'Big Money' coming to Drupal

Webchick: As funded startups and larger corporations try to get more features into core, we'll have more struggles with collaborative atmosphere. (Heyrocker adds:) This DrupalCon feels much more like a trade show than previous ones... and that's mostly due to the fact that Drupal has grown out of being a tight-knit developer community.

Drupal has become less centered around individual initiatives (at least, in core), and companies and startups getting funding are able to devote resources to shepherding initiatives. Examples: Acquia hiring Boulton design group to help with Admin UX, Examiner.com core patches to help with scalability, Commerce Guys core work to help support Drupal Commerce platform...

Sometimes, it feels like the collaborative atmosphere fades away (especially, for example, with regard to the admin overlay). This is a real problem, and a new one for the Drupal community. As time progresses, we need to work on refining our methods of attacking these problems, and maintaing a collaborative atmosphere. Alternatively, though, 'design by committee is not design at all' - sometimes, decisions do need to be made, and feelings will get hurt.

Webchick mentioned that the key to helping / improving Drupal, for a small developer or hobbyist, is to have a strong will, and get the ball rolling. For starters, just creating an issue will kick things off, and hopefully start a dialog with a maintainer to fix a problem or improve something. Don't be shy!

Realistically, though, small developers and hobbyists don't have the time or resources to shepherd large projects or initiatives. Thus, the ratio of smaller/individual developers contributing to Drupal core (vs. enterprise developers) is probably something like 99:1.

My Thoughts: In my own experience, as a developer of many personal websites, as well as many very large sites, I have found it to be the case that I simply couldn't do a lot of things I do with Drupal if I didn't rely on Drupal to help me with my full-time job. That's just a realistic observation of how Drupal is built (at least, on the core level).

On The Great Git Migration - Phase 1 vs. Phase 2

Webchick: One problem that we may see crop up is the expectation that people will be paid to help with major drupal.org infrastructure changes from here on out, because the Drupal Association had to pay developers to help with Phase 1 of the git migration.

What happens with phase 2? Will it ever get finished? This is a real worry in the Drupal community, and something to monitor in the coming year.

Another note: someone mentioned that we need to get out of the mindset that the Drupal Association will automatically kick in and pay for major initiatives. Rather, we all need to share responsibility for these things...

Webchick also mentioned the Git migration in relation to the current Stack Exchange situation... "Why did we not just use GitHub for our repositories? It's already built..." We wanted to maintain the collaborative community on drupal.org, for one, but more importantly, since all Drupal code must be GPL, we couldn't use GitHub—they have no requirement that code be GPLed.

My Thoughts: Unfortunately, during the major parts of this migration, I was doing work outside of Drupal, so I don't have much to say here, other than I love Git, and it's awesome :-)

On Having More Voices in the Drupal Community

Webchick: Does more voices mean more 300+ issue queues? More groupthink? Hopefully not. We need to continue to maintain a collaborative atmosphere, and help individuals and corporations both realize that they have a voice. The key, for the smaller voices, is to be willful, patient, and willing to be persistent.

Also, many times, someone will become unruly. If you find someone like this, try to find some common ground, work with the person, and guide them towards ways they can be more constructive. The person is probably trying to help, or do something, but is just frustrated.

We need to spread the word to everyone in the Drupal community: Helping with issues, and policing the community (argument resolution, solution finding) is not one person's responsibility—it's a shared responsibility.

My Thoughts: If we could get subscriptions working on drupal.org, that would at least delay the problem of 300+ comment issues ;-)

Recommendation: Make drupal.org Better

Webchick's final word: "Help us make drupal.org better!" (She said that's where she'll be focusing her efforts for the near future). Basically, work on making the tool we use to collaborate better, and everyone profits!

You can see my raw notes from this session in the attached text file below...

Comments

+1 for making drupal.org better
Now that D7 is out the door and locked for some years (at least in terms of what the general public will see and use), there are other fields that can get major improvements.

D.o. certainly is one. The hype around the app store, the plans to redesign the issue queue, ideas how to revamp the doc section: though the new d.o. is lightyears ahead of the old one, I feel it can only be a start and a scaffolding of things to come.

Good news: with all the professional deployment put into place with the d.o. staging servers, people that are entitled to be responsible for the improvement of d.o. (Neill Drumm still on it, what about Leisa Rex and others?) and a much nicer current design that is more suited to attract Interactive and artistic designers, tis is absolutely possible.

The plan of "initiative owners" and the git-like-thinking of working on a branch and having to pass gates to get "into core" (in the case of d.o. get live and launched) should be able to empower distributed initiatives that focus on single tasks. The styleguide created by mark should ensure design does not run wild and fraction the site visually.

Recently reading the book "Drive" by Daniel H.Plink I got to think again about funding community work. While it should not be expected and taken for granted, I am still for extending it and exploring it more. Using Kickstarter-like models it does not have to be the Association who is always asked to open the purse.

So, up the sleeves, golden times ahead!

I don't like at all the idea of providing support on some other external site, specially now we have the single sign-on feature on drupal.org which would allow creating any number of subsites that work seamlessly with drupal.org

However, atm, drupal.org forums are useless because they're just a collection of many random posts no one can keep up with. Still worse, as forums are not working, users end up posting their questions to the issue tracker, making it unmanageable too. But there are some easy things we could do and would make a big difference, like having more focused forums, one for each module or group of modules, that would be linked from the module page.

Some reflections on the issue, I wrote 1 year ago, http://reyero.net/en/drupal/drupal_org_all_about_size