Source note: Original social science practice passage. A study of civic apps compared notification frequency with notification relevance. Frequency was the number of alerts sent per week. Relevance was measured by the percentage of alerts about issues within a user's selected neighborhood or topic area. Civic response was measured by whether users submitted a comment through the app.