Measuring bikeshare performance — defining “success”

As a follow-up to the alternately captivating and disturbing transcription of my 12-minute interrogatory of an invisible seated Terry Bellamy yesterday, I’ve decided that a post on the super-sexy subject of bikeshare performance measurement is just the thing to seal your lifelong readership.  “Whattaya mean, ‘shut up’?”

So, in a comment on a prior bikeshare post, Richard Layman noted in the context of a discussion about a particular bikeshare system characterized as ‘successful’, “…if you define everything as successful (through constantly changing definitions) then you don’t learn and you don’t improve.” For the time being, I am not going to touch on the full basket-load of different areas where a bikeshare system should measure and benchmark, such as finances and customer service metrics, and will concentrate solely on a preferred ridership performance metric of mine.

A frequently-discussed metric is “rides per bike, per day.” Which makes sense for news stories, dinner conversation, and to be frank, easy understandable interpretation. But for a variety of reasons, I would propose that all of us interested bikeshare bystanders begin talking about “rides per dock per day.” In measuring performance, I think that we should cede a little on intuition for a lot more precision, and here’s why:

  • The bike quantity is too inconsistent as a measurement basis – How many bicycles a bikeshare system actually has deployed in use varies greatly, even intraday, and for reasons that can relate to operational performance. For example, bikes undergoing shop maintenance are out of circulation. Systems requiring large-scale intraday redistributions require taking bikes out of service routinely. Systems with relatively lower ridership rates may also put fewer bikes in docks to reduce “dockblocking.” The more bikes out of service, for whatever purpose and for whatever means, is bikes unavailable for riding.
  • This rewards low bike/dock ratio systems – A system with a lower bike deployment level by design to ensure system balance is using both bike and dock assets inefficiently by comparison. A system with a low bike/dock ratio due to maintenance or rebalancing time is rewarded with a skewed ridership picture stemming from operational inefficiency.
  • The dock is universally comparable – Unlike bikes, the supply of dock spaces is, on a day-to-day basis, relatively stable.
  • The dock is the true capital asset on which to measure operational performance – The dock makes up the majority of durable capital cost of a bikeshare system. Not only in the direct cost of purchase, but also the overhead labor necessary to locate and install a station, the rental or opportunity cost of the space on which the station is placed, and the longer service life of the station. All of these argue for measuring performance by how many rides the system managers can squeeze out of each dock space, rather than each bike, which is an asset with a much shorter service life and is laden with variable costs associated with use.
  • The dock is the thing that matters most – The scope of a bikeshare system is defined by the number of docks. The number of bikes really doesn’t matter, as long as there is at least one bike at their origin. The availability of docks at as many of their desired destinations as possible is what drives ridership. The more rides generated by each of those dock spaces is the best measure of how a system performs in creating bike rides.

Convinced? Wait, what? No? OK, let’s play with some numbers, and those of you rolling your eyes can feel free to just stop here, and maybe peruse some of my other posts.

System A has 12,000 docks, around 8,000 bikes deployed on any given day, and cranks out about 60,000 rides per day. Yikes!

System B, meanwhile, only has about 3,000 docks, has about 1,500 bikes deployed on an average day, and does about 11,000 rides per day. Not too shabby either.

If we look at rides per bike, per day, these systems look about the same. Every bike in System A is getting ridden 7.5 times per day, while every bike in System B gets ridden about 7.3 times. We would applaud System B for wringing as many rides out of each bike as the titans at System A.

But as I argued above, it is the number of docks that is the better basis on which to judge performance. And each dock space installed as a part of System A is generating 5 rides per day. Meanwhile, each dock in System B, which deploys fewer bikes per dock space, is only generating about 3.7 rides per day. System B either has excess dock assets, or is operating at less efficiency in generating ridership, than System A, as revealed when we measure rides per dock per day.

Well, I’ve convinced myself, which is always Job 1. So, in the weeks to come, I will try to start compiling rides per dock per day metrics for bikeshare systems that publicly release their data, and hopefully, we’ll have a more uniform method for measuring ridership performance.

This entry was posted in Uncategorized. Bookmark the permalink.

6 Responses to Measuring bikeshare performance — defining “success”

  1. Jacques says:

    I like the idea of a rides-per-dock per day metric, although I question the assertion that systems with a lower bike-to-dock ratio is using resources inefficiently.

    Some stations (those located in purely residential, or purely daytime-commercial locations) are not going to allow for many trips without having enough docks to ensure a reasonable chance of getting a bike/open space when you need one. Therefore, in order to have a higher number of trips, you either need more docks per bike, or more rebalancing vehicles.

    Outside of a low-bike-to-dock ratio or more rebalancing trips, this imbalance should decline as one of three things happens:
    1) The system installs more, but smaller, stations in these “last-mile” destinations, and the docks in those stations remain nearly empty or full for most of the day, while bikes circulate among…
    2) More “hub” stations, outside of metro stations or in mixed-use areas, from which trips originate and end from multiple types of locations.
    3) Bikeshare riders convert to full-time or part-time commuters on their own existing or new bikes, and their use of bikeshare becomes contingent on availability or circumstance.

    • bikepedantic says:

      I haven’t reread my post, but if didn’t qualify “inefficiently” with “relatively”, I should’ve.

      But my paper on the determinants of bikeshare ridership shows that those stations in single-use areas do show lower ridership. Not every neighborhood can be Dupont, and no large-scale system can locate exclusively in Dupontish areas. But in the aggregate, if you are filling only half the dock spots systemwide, it IS an inefficient use of assets, as measured by a ridership outcome.

      Each dock spot costs 2-3K avg, plus install/OH. In my “System B” example, there’s 500 dock spots unfilled systemwide by deployed bikes for reason _____ [siting, maintenance inefficiency, balance probs, whatever]. That’s $1-1.5M in capital cost that’s not necessarily generating ridership. Having other ‘antagonistic’ performance measures would tease out why, and to your overall point about siting in different environments, it’s a good practice if the ridership is outstripping the low # of bikes.

      But bottom line — if on a large-scale, a system is deploying fewer bikes per dock, and it’s only generating a similar ridership, that’s a big chunk of unproductive capital asset investment.

  2. Pingback: Bikeshare is to bike lanes, as Peyton is to the Colts | bikepedantic

  3. Pingback: Improving Bikeshare Operations, Marketing, and Ridership – Heartwarming Graduation Edition | bikepedantic

  4. Pingback: Burke, BHAGs, and Bikeshare | bikepedantic

  5. Pingback: Bikeshare Bike to Dock Ratios | bikepedantic

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )


Connecting to %s