Redesigning the Open Communities Alliance Housing Mobility App to Increase Ease of Use

Posted on

As scholars have discussed, housing opportunity has a tremendous impact on people’s lives and life outcomes. 1 Many social workers and non-profit organizations are dedicated to helping people find better housing opportunities. The Open Communities Alliance is one such organization. The Alliance is a Connecticut-based organization that aims to improve opportunities for all through policy and advocacy, with a focus on housing opportunities. The Open Communities Alliance has developed a tool to help individuals with housing subsidies find better communities and homes. The app aims to present three broad categories of relevant information to the user: An opportunity level index that measures opportunity levels across census tracts, “neighborhood assets” such as schools and grocery stores, and transportation information in the form of “get directions” links to Google maps.

Current Housing Mobility App
The Housing Mobility App, here shown in its current format, has rich information to offer users but also has room for improvement. 
source

While it is an excellent initiative, the mobility app is not yet as effective as it could be in helping people find homes and communities to move into. Through a housing-information event organized on April 15, 2015 with the help of the Open Communities Alliance and the Middletown North End Action Team, our class was able to conduct interviews with locals who would potentially find the application useful. 2 Through computer screen recordings of interview participants, we were also able to collect data on what parts of the app users were using.  The interviews and data from the housing event indicate that while there is a clear interest in information that the app presents, the Mobility App is not highlighting the information that many individuals are interested in.

Our findings about workshop participants’ patterns of usage on the app can be summarized with the following table that we created as a class. The Stayer or Mover column describes whether participants said they were interested in staying in their current homes or moving. The next two columns serve as different ways of measuring computer familiarity, with New or Regular column using self-reports and the Search without Assistance column using behavioral observation. The green columns reflect observation of the order in which participants clicked on different features of the app. The pink columns show the order in which participants verbally described the features of the app.

One of the largest current problems with the app is that it does not supply information about actual apartment and house listings. The app has good information about opportunity levels and assets surrounding certain addresses, but this only goes so far in helping people find places they may actually live in. The Open Communities Alliance website states, “The Alliance is dedicated to bringing resources to lower opportunity areas and linking to higher opportunity areas people who historically have not had access to them.” The Housing Mobility App does not currently meet this goal adequately. In our class’s community housing workshop, most participants did not click on the opportunity levels at all. As can be seen in the chart above, only 5/14 (36%) of participants clicked on the opportunity levels, and only one participant out of our fourteen clicked on the opportunity levels first. It would be helpful for the housing mobility app to have access to information about specific apartment or houses to rent in higher­ opportunity areas.

People who attended the community housing workshop cited the app’s lack of real listings as one of its most significant flaws. One participant said, “What are these, like, spots you can move?” when ze saw the dots for the neighborhood assets. 3 The same participant commented that ze liked the security deposit on the Portland, CT listing we showed workshop participants. This suggests a demand for information about specific housing opportunities in addition to the information about neighborhood assets and opportunity levels that the app already provides.

In the next version of the app, it would be helpful to incorporate housing listings from a rental listings website, such as CTHousingSearch, and to have these listings represented as points on a map of the area. A May 1st and May 10th, 2015, comparison of listings of Middletown apartments on Trulia, Realtor.com, Zillow, and CTHousingSearch suggested that CTHousingSearch might be the optimal choice for a source of data to use in conjunction with the app. CTHousingSearch had more listings overall for Middletown housing opportunities (43 postings, compared to 38 on Trulia, 28 on Realtor.com and 26 on Zillow) and more listings for opportunities under $1000/month (33, compared to 15 on Trulia, 12 on Realtor.com and 9 on Zillow). CTHousingSearch is a housing locator service funded by the Connecticut Department of Housing that aims to help individuals and families to find the best housing for their needs. 4 The organization shares a similar mission to Open Communities Alliance and therefore would probably be inclined to help furnish listings for the housing opportunity app. An advantage of Zillow, however, is that Zillow presents its listings on a map of the area, which is what we propose for the app to do as well. Therefore it might be easier to pull location data from Zillow listings than from CTHousingSearch, but this would need further investigation by someone more familiar with the technical demands this would impose.

To make the listings very visible, we propose that they be represented with individual balloons indicating an apartment or house for rent. A really clear redesign would be to completely remove the census tracts, (which the app currently uses to show opportunity levels), but to color code the available housing markers by census opportunity level. This would allow users of the app to see clearly where the apartment or house was located with respect to familiar streets or neighborhood assets while also benefitting from the information about opportunity levels. We looked at ColorBrewer and concluded that using a sequential color scheme, like the app currently does, is the most clear way to represent the gradient of opportunity levels. Some of our workshop participants had trouble distinguishing between the shades of orange when they were made less opaque in order to show the streets, but because we propose to use balloons to show individual listing opportunities, the balloons can be opaque, and thus the colors will be easily distinguishable from one another. Here is what this might look like:

Housing Mobility App Housing Listing Redesign
This is our proposed design for the representation of housing listings. This is what the open listings as of May 10, 2015, look like in Middletown, displayed as individual balloons that are color-coded by opportunity level.

To distinguish the listings from neighborhood assets and to ensure that the listings were the most prominent feature of the app, we propose that they be represented as balloons akin to the ones Google uses. Users could click on the balloons to get more information (opportunity level as well as a link to the posting on CTHousingSearch or Zillow) about the house or apartment listing. The neighborhood assets could be dots as they are in the app currently. This change to the app would allow housing listings to come first, which could really help people looking for housing make their decisions based on actual listings and locations without sacrificing the important opportunity­ level data and neighborhood assets.

The feature that was least evident to most participants was the transportation information. The availability of transportation is a huge factor for many looking for a new home. The lack of access to a regularly running bus can make it difficult, dangerous, or impossible to get to a job, school, or grocery store. In the current format of the app, transportation is limited to a “get directions” link that takes the user to a new Google Maps page. Before it was explained, none of the fourteen participants clicked on or described the presence of this feature. This is a terrible shortcoming of the app, considering how important access to transportation is to most individuals when considering a new home or school for their children. Participants 3, 4, and 14 all referenced a need to understand different aspects of transportation during the process of finding housing despite there already being a section of the tool dedicated to housing. Any redesign of this tool must address this issue, because the inclusion of neighborhood assets or housing offerings are not as enlightening when users can’t find out how accessible they are.

It’s clear that linking out of the application for transportation information isn’t a very obvious feature to many. It would be better to include transportation information directly in the app. This way, it would be easier to use alongside visuals for opportunity level, housing, and neighborhood assets. The first and most simple step is to use a street map for the application instead of the map of census tracts. Being able to visualize a neighborhood’s roads and streets is the first step to understanding how one’s day to day travels will pass. The census tracts give very little in the way of understanding scale, population density, and nearness to highways or public transportation, all of which have an impact on living.

Here is an example of how a bus route could be shown. This example uses a shuttle route in Hartford. The word bubble is an example of what could pop up if the user mouses over the route.
Here is an example of how a bus route could be shown. This example uses a shuttle route in Hartford. The word bubble is an example of what could pop up if the user mouses over the route.

The next truly helpful asset would be to add bus (and other public transportation) routes and stops directly to the app. A good redesign would include an overlay of the different routes and stops on the map. Users should be able to hide or show this feature, just like the neighborhood assets. Also like the neighborhood assets, when clicked, the line would show a text box with the name of the bus or stop, along with a relevant phone number for the area’s CT Transit. This feature would not replace the “get directions” link, but would rather enhance its function. While this tool would not be as effective as the “get directions” link in finding tangible directions, it would provide a quick and broad understanding of how transportation in different neighborhoods compare to each other. This is an important layer of understanding that is not covered in the neighborhood assets or the opportunity index – a neighborhood can have wonderful schools, low crime, and high average incomes, but if life there requires a car, these positives would be of little use to a family without one.

The neighborhood assets feature was by far the most utilized in our housing workshop. Ten of the eleven individuals who clicked on any part of the application without assistance first clicked on neighborhood assets, and all eleven clicked on neighborhood assets at some point. By comparison, five people clicked on the shapes representing census tract opportunity level at some point, and no one clicked on the “get directions” link. This implies two things: That the way in which the neighborhood assets are represented in the tool is highly effective, and that neighborhood assets as a category are interesting to individuals who the app is designed for.

Many of the participants used items that could be labelled as “neighborhood assets” to decide whether or not a potential new home was in a good area. For instance, Participant 5 was interested in living near a community center. Participant thought that adding more points for things like public parks. Other participants wanted to find libraries and hospitals. These all could be listed alongside the current neighborhood assets.

In many ways, individuals were looking to these points as indicators of a good area. This is understandable – it is often crucial to live within a safe walking distance to a school or grocery store, or at least a bus stop to get there. For many, this is a basic necessity when looking for housing. However, this information in itself cannot stand in for the opportunity data. One might assume that high opportunity neighborhoods are more likely to have more neighborhood assets, but a quick examination of the mobility app shows otherwise. For all of the urban centers in Connecticut, the city center tends to have a lower opportunity level and quite a lot more neighborhood assets than the surrounding suburbs. This makes perfect sense, but it means that neighborhood assets alone are not adequate indicators of high-quality neighborhoods.  Likewise, a high opportunity neighborhood might lack a grocery store within within walking distance of many homes. Neither opportunity levels nor neighborhood assets are adequate rubrics on their own, and both are hardly useful at all without an understanding of transportation.

Additionally, a stumbling block to many users of the app was the app’s overall lack of intuitiveness. Many participants in our focus group indicated that they were confused about what to do with what they were seeing in the app.

One specific major issue common across several participants in our housing workshop was that they found it difficult to orient themselves in the map. People said things like “How did I lose High Street?” 5 and “like where would Main…does it show like streets? Like where would the Y be from there?” 6 which indicated confusion. By changing the opportunity levels to colors of the balloons, as suggested in our discussion of housing listings earlier, the map would be clearer, and participants would be able to see specific streets and familiar landmarks more clearly. Having features pop up when you hovered the mouse over them instead of when you clicked them would also help with increasing the ease of use and reducing the clutter of the app.

Part of this struggle we observed in some of our participants may be attributable to the digital divide. A majority of the participants in our housing-app test session were not familiar or proficient at using computers (only 43% of our participants could use the search tool unassisted), and this represents a major potential-user population that may need different features to help them use the app. Several participants who were not very familiar with computers indicated that something of this nature would be helpful. One participant said, As Participant 5 said, “I think if something that could explain it for people that don’t know the computers, that would be really helpful.” Other participants indicated that more guidance would help them, making statements like “So what are we looking for?” 7 and “So what do I have to put there?” 8 If people can’t figure out how to use the tool on their own, they will not be able to take advantage of the valuable information the app contains.

A thorough tutorial could help people with digital literacy struggles use the app. Ideally, the information in the tutorial would go down the the level of telling people what to click on and where to type in information to help people who were extremely unfamiliar with computers and might not have the same intuition-based abilities to figure this out as more computer-savvy users. This might look something like this:

(Direct link to slide show above: https://docs.google.com/presentation/d/1eQVFFhMVfjBk-GEL3C34YBxkQ1Rc1knFSkrKeQlny54/pub?start=false&loop=false&delayms=3000)

We believe these suggestions will improve the housing mobility app and increase its utility and ease of use for those most in need of better housing opportunities. With our additions and revisions to the app, people will be able to find specific places to live, get a realistic sense of their transportation options, see enriched neighborhood assets, and understand how to make use of all this information even with limited computer skills. The Housing Mobility App has the power to be a tremendously helpful resource to housing mobility counselors and people looking for better housing opportunities for their families. These suggestions would make the app even more closely aligned with CT Open Communities Alliance’s mission to help people who historically may have not have had access to high opportunities have a chance to succeed.

Notes:

  1. Boggs, Erin. “Commentary: Why Mapping ‘opportunity’ Matters.” TrendCT. April 14, 2015. Accessed May 12, 2015.
  2. The interviews, conducted by Wesleyan CSPL 341 students at the Middletown North End Action Team, are kept confidential to protect the identities of the fourteen participants. They will be cited by participant number.
  3. Participant 10A.
  4.  “About Us.” CT Housing Search. 2015. Accessed May 12, 2015.  
  5. Participant 1.
  6. Participant 13.
  7. Participant 9M.
  8. Participant 11.

Selection Bias and Internal and External Validity in Climbing Mount Laurel

Posted on

As we have discussed in class, selection bias poses a significant challenge in evaluating the benefits of housing and schooling programs that involve both random assignment into groups of applicants who do and do not get into the desired program as well as differing levels of motivation to apply to the program in the first place. The authors acknowledge the possibility of selection bias in their research and make efforts to account for these effects, but I ultimately thought this was a flaw in the design of their study.

Massey and colleagues make appropriate analyses of the differences between groups, as they compare applicants to the Ethel Lawrence Homes who did and did not get accepted to live there. They note, “both current and former residents and nonresident applicants have self-selected into the group of people seeking to leave their current homes and move into the Ethel Lawrence Homes, thus holding unmeasurable traits such as motivation and gumption more or less constant” (74). The researchers claim their methodology thus produces a study with a high level of internal validity, and I agree with them there. Their comparison groups reminded me of the groups we as a class decided to compare when assessing the benefits of attending a particular school or type of choice school. However, even though the results may reflect real differences that can be causally attributed to residents in the Ethel Lawrence Homes, it is necessary to acknowledge that the lack of randomness in these groups may be a major flaw in generalizing the results.

The managers of the Ethel Lawrence Homes decide who may reside there through a process that is explicitly not random. In Chapter 5, Massey and colleagues write,

Applicant screening is thorough and includes credit checks, criminal background checks, income verification, and a home visit. Of the population seeking affordable housing in New Jersey, then, the residents of Ethel Lawrence are a screened subset of people who are probably less likely than poor people in general to have the proclivity, knowledge, and ability to engage in criminal or delinquent activities” (90).

This language reminded me of the rhetoric of “creaming” that is often brought up with respect to charter school admissions. Most particularly, the ELH admissions process seemed analogous to the “Hooping it Up” and “Send Us Your Best” items from Kevin Welner’s article on the charter school dirty dozen. In the descriptions of these items, Welner argues that charter schools often make the application process so arduous that only the most committed will follow through and that they also place requirements on enrollment that ensure that the already-highest-performing students get in. Similarly, in Mount Laurel, a creaming process seems to be taking place, and the authors acknowledge this at the very end of Chapter 9, but they do not delve into the effects that this has on the community or how it might influence their findings. Their comparison groups are chosen aptly, but they are not random, and to describe the results without mention of this critical fact is a large flaw.