Summary of violations

HeuristicSev. 1Sev. 2Sev. 3Sev. 4Total
H1: Visibility of Status05016
H2: Match Sys & World21003
H3: User Control13408
H4: Consistency & Standards14005
H5: Error Prevention00426
H6: Recognition not Recall14005
H7: Efficiency of Use24006
H8: Minimalist Design12104
H9: Help Users with Errors00101
H10: Help & Documentation01102
H11: Accessible02103
H12: Value Alignment & Inclusion02002
Total82812351

Severity 1 is a cosmetic problem, 2 a minor usability problem, 3 a major usability problem that is important to fix, and 4 a usability catastrophe that is imperative to fix. No violations were rated severity 0.

Severity 3 and 4 violations

SeverityHeuristicViolationSuggested fix
4H1: Visibility of System StatusThere doesn't seem to be a way to view how the post actually looks on the social media that it gets posted to, and there is no link to "open in instagram" or something similar.Add some ability to preview how it looks in the social media app and/or add a link to open/access the post in that app.
4H5: Error PreventionAfter choosing a platform, users can immediately tap 'Post now' without a final confirmation.Add a confirmation screen showing the selected platforms before publishing.
4H5: Error PreventionAllows you to click post with no social media selected.Add error message/prevent posting with no social media connected.
3H3: User Control & FreedomIn the Inbox, users can send an AI-suggested reply directly without opening the edit screen first.Add a confirmation or preview before sending suggested replies.
3H3: User Control & FreedomOn the Review post screen, users can edit the caption, but there is no clear option to return and change the original photos or voice note.Add an 'Edit story' button that takes users back to their original inputs.
3H3: User Control & FreedomOn "Your story," there is no way to remove a medium.Add a "remove" button, for each medium and/or per photo.
3H3: User Control & FreedomI don't like how the "gather" stage of the AI generated post is formatted because I think that it is not close enough to what it will be in the end so it will end up being a lot different than how the user may have expected it to turn out (I fear it will be tough to allow the users voice/creative style to shine through)… I think that it tries to rely on AI too much and it would be more beneficial if the user could choose very specific things for AI to help with, but as you have it now, it is the only option and it totally skips over the "write" section of the posting process.I would say that it would be nice to see the images at the top of the post so that it begins to look more like a real post earlier in the process. This could be done by moving the photos to the top and also converting the voice memos into text and maybe giving them a chance to add emojis or something.
3H5: Error PreventionThe 'Post now' and 'Post later' buttons appear close together on the same screen.Make the immediate publishing action more distinct or require confirmation before posting.
3H5: Error PreventionIncorrect wiring of frames around disconnecting instagram → clicking back button will prompt you to disconnect instagram again indefinitely.Rewire frames to back out correctly.
3H5: Error PreventionAllowed to disconnect all social media without any consequences or warning?If user disconnects all social media, give them a warning or notification letting them know what that means?
3H5: Error PreventionBack arrow after generating a post is broken and regenerates.Make back arrow properly navigate to before generation of post.
3H8: Aesthetic & Minimalist DesignOn the Your story screen, the fixed 'Generate post' button overlaps the lower part of the 'Add more' section.Add more bottom spacing or make the content scroll above the fixed button.
3H9: Help Users with ErrorsOn the “Where should it go?” screen, users can choose different social media platforms, but there is no clear indication of what happens if a post fails to publish.Show a clear error message explaining which platform failed and provide a “Try again” button.
3H10: Help & DocumentationOn the “Your story” screen, there is no visible help option explaining how Telly uses voice notes, photos, and text to generate a post.Add a small information icon or a short example explaining how Telly turns different inputs into a post.
3H11: Accessible DesignOn the "Inbox" page, the "Edit" and "Send" buttons are dangerously close to each other.Put them on opposite ends or give them more space. Additionally view the separate violation of not having an "Are you sure" pop up before it gets posted.

Evaluators’ summary recommendation

It feels intuitive, but it almost feels too streamlined at times. There is a clear tension between the automation and the personalization. "Authentic reviews" will be the design value, but the tension of having AI to automate every post and replies will be a concern for us. It would also be great if you had "disable AI" options so users have the ability to write posts and feel more authenticity in the automatic responses. More specifically, users should be able to customize what exactly AI works with, possibly disabling the specific functionalities they don't want AI taking over. People want to feel like the creative mastermind. To leverage this AI workflow further, the app should be able to adapt posts to different social medias.

Full report

Evaluator names have been removed from the posted report and spreadsheet.