ApacheCon Big Data/Core News Wrapup

Our annual Apache:Big Data and ApacheCon:Core events were held recently at the lovely Corinthia Hotel Budapest, and the content and attendees were amazing.  The weather was great too, and sightseeing and shopping in Budapest were lovely.  Attendance was still good even in the face of time-competing software conferences and the local refugee crisis happening in the region.

While they were booked as separate events, many people stayed for the whole week.  Going forward, we will likely have a single event, but be even clearer with the strength of content in specific track days.  The broad array of very deep and well-received technical content in the big data space was truly impressive; Apache has over a dozen big data related projects and probably 20 more incoming Incubator podlings, so we certainly have the space covered!

We got some great press coverage and a few independent blog posts with key events at ApacheCon Budapest this year:

Overall, ApacheCon is always a good week for me, but this year it was exceptional. The Corinthia was as lovely as ever, and I finally had time to really take a walk and shop in the central market in Budapest. Plus, Thursday was a special day for me, and somehow everyone at the conference (including the hotel staff) found out, and was wishing me well. Many thanks to the friends who took me to an authentic Hungarian restaurant for dinner! Even the gypsy band playing a version of “Happy Birthday” was fun, and I’m glad I got to bring home the music of Norbert Salasovics!

Our conference producer the Linux Foundation has been really improving how we organize our CFP and put together highly focused tracks on a variety of Apache projects.  While it’s hard to put a spotlight on all 200+ projects and initiatives at the ASF, expect to see even better organized content and talks in the ApacheCon to come, with full in-depth tracks on key technologies – along with excellent community and “how does Apache do it all” advice to boot.

Slides for all talks and videos for keynotes should be posted on the event archive websites:

Many of our speakers use Slideshare as well, and the Apache Community Development project has a separate listing of some key Apache Way slides.

Stay tuned for the CFP for ApacheCon North America, which will be returning to Vancouver, Canada on 9-13 May 2016. Hope to see you there!

Congratulations to the 2015 Apache Board of Directors

The ASF recently held it’s Annual Member’s Meeting where all Members of the Foundation cast ballots in the annual election for the Board. We are lucky to have had a number of excellent candidates for the board as always.

The new board comprises:

  • Rich Bowen
  • Shane Curcuru
  • Bertrand Delacretaz
  • Jim Jagielski
  • Chris Mattmann
  • David Nalley
  • Brett Porter (chairman)
  • Sam Ruby
  • Greg Stein

I also keep a graphical history of the ASF board.  The graphic there is a great way to see the slow but steady progress of electing new faces to the board over time.  Thanks to all the active Members who voted in the elections!

As the ASF grows in projects, communities, and Members, we’re looking forward to continuing to support our now 165+ top level Apache projects going forward!

Note that a number of new Apache Member nominees were also elected; however we don’t share their names until they’ve all been contacted and have accepted the invitation.  Stay tuned in a month for that announcement from @TheASF.

Shane’s Apache Director Position Statement 2015

The ASF is holding it’s annual Member’s Meeting this week to elect a new board and a number of new Members to the ASF.  I’m honored to have been nominated to stand for the board election, and I’m continuing my tradition of publicly posting my vision for Apache.

We are lucky to have a large roster of excellent director candidates, so no matter how the election turns out we’ll have a stellar board. Given the wide variety of opinions in our candidates, I urge all Apache members to set aside the time this week to carefully consider all the board candidates, as well as all the great new Member nominees.  Please vote – and if you’re not free this week, be sure to assign your proxy for the meeting attendance: I and several other Members are happy to proxy for you.

Please read on for my take on what’s important for the ASF’s future…

Continue reading

How Apache *really* works

How much do you know about the Apache Software Foundation (ASF) and the many Apache projects we host? Did you know we’re holding our annual Members meeting to elect our board of directors and new Members in just a few days?

I’m often surprised by the variety of basic questions and misunderstandings I hear in the software world about how the ASF really works. We’ve written plenty of documentation about the Apache Way and our governance, but let’s try a different approach. I’d like to interview myself to try to explain some things.

So, Shane, what *is* Apache? I thought it was that web server?

The ASF is a non-profit, public charity, 501(c)3 membership corporation with the mission of producing software for the public good. The Apache HTTP Server project (to use it’s formal name) is a project community at the ASF that creates the httpd web server, which has powered more active websites than any other server since 2000.

The ASF is the corporation that provides legal, branding, press, fundraising, and infrastructure support, and proven community mentoring to the many Apache projects like the HTTP Server. Think of the ASF as a great big house, where we provide shelter for a lot of different families that write open source software.

Well how many Apache projects are there?

We have over 165 different projects, and about 40 podlings. These 200+ project communities create a wide variety of software products, including Apache Hadoop, Apache Lucene, Apache OpenOffice, Apache CloudStack, and many, many more.

You are almost certainly using multiple Apache products right now as you read this. You may not realize it, but much of the plumbing of the internet uses Apache software to keep servers organized and connected. Most browsers use various Apache products under the hood for a wide variety of utility functions. It is our project communities that actually create the software you’re using — the ASF just helps keep them organized.

How does the ASF organize all these projects?

The ASF provides all the infrastructure an open source project needs: websites, code repositories, mailing lists, bugtracking services, a crack infrastructure team. We also provide all the rest of the services that a project will want, like legal support, access to press releases or analyst contacts, and some fundraising support. The ASF also owns all Apache trademarks on behalf of our projects, to ensure they get the credit they deserve.

Most importantly, the Apache Membership and many of our 4,000+ Apache committers provide the community mentoring and support to keep our projects running smoothly, with an independent project governance. We have many passionate Members with amazing experience in making open souce projects work, and they volunteer to help keep our projects healthy and running strong.

But this is mentoring and guidance, not direction. The ASF does not direct the technical direction of our projects. We let the people doing the work — the project committers and Project Management Committees (PMCs) decide where the code should go.

So the projects direct themselves. But what is “independent project governance“? How do you enforce it?

A critical behavior for any Apache project is independent governance. That means that every project manages their code for the benefit of all users (the public good), and not just for some company or vendor. In particular, the ASF and Apache projects only recognize individuals as committers or Members — never companies.

We expect when committers are working within their Apache project, they are acting for the best interests of the project itself. But we also have checks and balances: all Apache projects report formally to the board of directors quarterly. The board reviews project health — are they acting indepenently, are they publishing software releases, are they voting in new committers. If the board sees behavior that does not show mature Apache project behavior, the board will work within that project community to help the project community correct itself. Many Apache Members also volunteer to mentor our projects in these cases. In extreme cases (very rare), where a project does not follow the Apache Way, the board will unilaterally make changes to correct their course.

Can you clarify who are the board, the Members, and how they relate to projects? Are Members part of all projects?

Imagine Apache as a condominium association with multiple condos together. The ASF as a corporation provides the building. Like some condo associations, we also define a few expected behaviors and appearances for all the condos we offer. We also offer bonus services, like help moving into your condo or fixing things up. Each Apache project lives in one of these condos. We’re happy for you, the project community, to live your own lifestyle within your condo and paint the inside whatever color you want, as long as your public behaviors when you’re here follow our community best practices.

Here, the Apache board is the board of the condo association. They set the core rules and guidelines for the building. The Membership are sort of the owners of the building — not that they can ever sell their shares or make a profit, but they are the only ones who can nominate and elect the board. The board appoints all the officers who set detailed policies and make all the operations of the building work, like trash pickup and elevator maintenance.

Every Apache project condo has at least one Apache Member involved with the community: the Incubator requires that every new project has a few Members interested in that community to help mentor it. But within each project condo, the code direction or decor choice is completely up to the whole project community to decide. Membership in Apache is not transitive to any project: Members need to be elected to your project to have a direct say in it.

The ASF offers a lot of services to projects. How does this all get paid for?

The ASF board approves an annual corporate budget of about one million dollars. Our primary income is from our formal Sponsorship program, where organizations can provide a regular annual donation. As a 501(c)3 charity, we also have many individual donors, and some authors donate royalties from their books about Apache software to the ASF.

Importantly, sponsorship of the ASF does not provide any influence over Apache operations nor the operations of any projects. The ASF’s mission is to serve the public good, and while we very much appreciate our generous sponsors, we do not serve them: we serve our project communities and software users.

Sponsors provide a variety of reasons why they sponsor the ASF, many of which relate to how we host so many different critical software product communities. As one sponsor said, “Apache builds the plumbing of the internet”. Some sponsors and donors simply want to give back to the ASF in appreciation for all the software we provide for free.

So the Sponsors can pay for Apache project development, interesting.

No! Sponsorship funds are purely undirected — we do not accept donations with ties or requirements. By policy, the ASF does not pay for core development on any Apache project. All our budget is used for the support services that allow our project communities to do their work — which is building Apache software.

Do any Apache committers get paid for their work?

Of course — but not by the ASF. Many committers are working on Apache projects on behalf of their employers, who may be software vendors providing support, hosting, or add on products for that Apache project. Some committers are independent consultants, trainers, authors, or the like, who make their own living from helping other people use Apache projects. And a lot of committer work is done simply because that person needs to fix a bug or add a feature that they need for themselves. With so many people using Apache software to run their businesses, most work is self-serving: building code that they need.

The ASF provides a vendor-neutral place where everyone who benefits from Apache software can collaborate to improve that software. The ASF does not have an agenda or direction — we rely on the people using our software to help improve it.

Well… how much do *you* get paid at Apache?


No, seriously — how much do you get paid for this?

Seriously: nothing. Zero. Zip. The ASF has never paid me for my work here, and my current dayjob is wholly unrelated to my Apache activities. I’m here purely as an unpaid volunteer.

How did you get to be at Apache? What drives you to do all this unpaid work?

I first started committing code to the newly formed Apache Xalan project shortly after the ASF was incorporated in November 1999. At that time, I was paid by Lotus/IBM, my employer, to contribute to the Xalan as part of my job. I also got to attend and speak at a few ApacheCons to try to promote our work on Xalan and Xerces.

Over time, my dayjob changed direction, and turned away from Apache, but I was still interested in how the ASF worked. At ApacheCon I had followed a friend into a conference planning meeting to see how it worked, and I walked out of the meeting with assigned tasks for the next ApacheCon. Once I started helping with events, I was hooked. In 2002 I was elected as a Member of the ASF, and got to see how the sausage was made from the inside. In 2004 my job changed to be wholly unrelated to any open source work, but I was already personally invested in the ASF and our many excellent communities.

I volunteer at Apache for several reasons:

  • This is how I give back to the world. I’m lucky enough to have a healthy family, nice home, and stable job. I volunteer my extra time to help make it easier for Apache project communities to build more free software for the public good.
  • I love the ASF and it’s people. I’ve met so many amazing people at ApacheCon and within our projects, and it feels like much of the Apache Membership is one big family. Sure, we fight plenty, but we also buy each other plenty of free beers and meals.
    Helping open source communities get organized and keep their volunteers motivated is something I’m good at, and something I’d love to do more of if I could. Volunteering at Apache is a huge impact to my personal brand and my future job prospects.

Wow, that’s been a great interview Shane! How should we wrap this up?
It’s been a pleasure. Thinking about what motivates me, this is one of the things I love doing: explaining technology and communities to interested audiences. This is also great timing for this interview, because the ASF is having it’s annual corporate meeting where the Membership elects a new board.

We have a truly stellar list of director nominees this year: looking at the candidates the Membership has nominated shows just how talented and friendly all our candidates are, and how any of them would be a help to ensuring the smooth operations of the ASF in the year ahead.

Since I do have the microphone, I will make one short plug to note that I’m also running for a seat on the board. I’ll be posting my director nomination statement — a note detailing why I hope Members will vote for me — soon here on my open source blog, Community Over Code.

Good luck with the election Shane — it sounds like Apache is in good hands no matter who gets on the board.

Yup. While we still have a way to go to make it simple to understand Apache for newcomers, the ASF and our project communities are doing amazing work, and often having a lot of fun doing it. Apache plans to be around for the next 50 years providing a stable home for like-minded project communities of all sorts.

Thanks for the interview — this was great to talk to someone about this!

Shane volunteers as the Vice President of Brand Management for the ASF, although all content here is his own personal opinion. He is not normally an interviewer, but does sometimes play a trademark lawyer on the internet. He hopes you liked this article, which also appears on Medium, and will ask him any questions about Apache that you might have. He promises to stop writing in the third person now.

Three key elements defining any open source project

Open source has come a long way in the past 30 years and is entering the consciousness of most modern cultures. When thinking of open source projects, people categorize them several ways: governance structure, type of product platform, programming language, utility, technical details (language written in), industry sponsored or fully independent, and more.

But what truly defines any open source project, making it a unique entity different from all other open source projects? I would propose that there are three key elements of any open source project that frame, define, and differentiate that project from all others: the code, the community, and the brand.

Continue reading

Even better than Hadoop!

You know what’s even better than using Hadoop? Using Apache Hadoop!

Even better is Apache Ambari to manage your Apache Cassandra data store through Apache Hive with Apache Pig to make it simpler to write Apache Spark compute flows… Or, if you want it assembled for you, just grab the latest Apache BigTop, which already includes a bunch of Apache Hadoop related packages all together.

How can we do a better job of getting at least a single “Apache Hadoop” into some of the many media stories about Hadoop these days? It’s great that all these vendors are making great technology and projects that power big data, but with all their success and fancy marketing campaigns, you’d think we could get just a tiny bit of credit in the popular press with the actual committers on the core Apache Hadoop project itself. Or any of the other Apache project technologies that these vendors, other software companies – and just about every other company too – rely on every day to help make their websites work.

Would it hurt marketers and journalists and bloggers to throw in just one extra “Apache” before talking about the many free Apache software products that help power more than half the internet?

The ASF and Apache projects give away a tremendous amount of technology every day under our permissive Apache license – always for free. All we ask is respect for our trademarks, and a little bit of credit for the many volunteer communities that build Apache software.

P.S. Apache projects love to get more code, documentation, testing, and other contributions too! And the ASF has a Sponsorship program.

But what we we really want is what every human wants: just a little love. Just an extra Apache here and there makes us feel better.


It’s Groovy to join a Foundation

The contributors behind the awesome Groovy project are looking for a new home. It’s bad news that the project and some of its core contributors will no longer be sponsored (paid for) by Pivotal, but it’s great that the core contributors are organized and serious about moving their project to an existing Foundation.

As a long time Apache Member (among other things), I have a few suggestions for the Groovy community.

Continue reading

ApacheCon Europe 2014 Blog Roundup

As our intrepid conference master and ASF’s EVP Rich Bowen Notes in the Margin,
we recently held a spectacular 24th ApacheCon at the beautiful
Corinthia Hotel in Budapest, Hungary – followed by the CloudStackCollab
conference focused on the fast-growing Apache CloudStack project.

Rich, LinuxFoundation production staff, and an array of Apache volunteers put
together a great set of talks with some very focused
tracks on specific days – both for technology as well as for community
and business interests around Apache projects. As Rich notes: if your are an
Apache committer and want to speak, or see your project represented at
the next ApacheCon US April 13-17th, 2015, in Austin, Texas then sign up to help organize!

Here’s a roundup of Apache folk’s blogs about the event:

Unfortunately we don’t have video for talks this year. That means that folks
who couldn’t attend are missing out on an inspiring keynote from this year’s
conference: David Nalley talking about the Value Of The ASF. This is one
of those talks where the slides don’t make sense without hearing about it.
David came up with various figures representing the “value” of the code that
all Apache projects provide – and they’re massive numbers. More importantly,
the larger value of the ASF is the proven Apache Way of organizing
large-scale, long-lived collaborative activities between heterogeneous
groups of individuals – and making it work in a way that allows companies to
invest their resources (employee time and sponsorship) without impinging on
the independent governance of Apache projects.

Matching our inspiring talks was the friendliness of the
staff at the beautiful Corinthia Hotel Budapest, along with the beauty, history,
and warmth of the city of Budapest and the people of Hungary. A week alone
is not enough to see the sights of the city, and it’s no where near long
enough to enjoy all the wonderful food and drink there! Here’s hoping that we’ll
be able to come back next year!

So, I gave this talk at OSCON

So, it was short, but an important message that I don’t think many open source project participants are really thinking through yet. So, it was all about how BRAND > CODE, and I’m looking for feedback on how to expand this, so, into a much bigger and better talk.

OSCON Ignite 2014: BRAND > CODE, by Shane Curcuru

So, you have to understand: yes, watching the video is so painful. I’m not usually that so-so. It was a combination of nerves (bigger stage than expected), jetlag, E_NOTENOUGH_PREPTIME, and the fact that my cell phone had just taken a dip in the water a few hours earlier.

OSCON was awesome, by the way. Next year looking forward to making sure my travel plans include the Community Leadership Summit!

I use Slideshare, and I speak at ApacheCon on managing community brands and making profits while respecting brands.

Congratulations to the 2014 Apache Board of Directors

The ASF recently held it’s Annual Member’s Meeting where all Members of the Foundation cast ballots in the annual election for the Board. We are lucky to have had a number of excellent candidates for the board as always.

The new board comprises:

  • Rich Bowen
  • Doug Cutting
  • Bertrand Delacretaz
  • Ross Gardler
  • Jim Jagielski
  • Chris Mattmann
  • Brett Porter (chairman)
  • Sam Ruby
  • Greg Stein

I also keep a graphical history of the ASF board.

As the ASF grows in projects, communities, and Members, we’re looking forward to continuing to support our now 151 top level Apache projects going forward!