A few things to think about:
- Acceptance/rejection rates
- Citations in other journals
- Journal found in indexing services
- Articles are up to standards of field
- Reputation and metrics (journal impact factor or rank or Eigenfactor)
- Editorial board members and reviewers are experts in the field
- Transparency of scope, policies, contact information, author rights, licensing, etc.
- Preservation of content for continued online access
Reputable Open Access Journals should meet the following standards:
- Content is freely available upon publication
- Be a member of the Open Access Scholarly Publishers Association OR adhere to its Code of Conduct
- List article publication fees
- Content is often published with an open license (not always)
- Should be indexed in a major indexing and abstracting service (some reputable journals are not indexed - so use this in addition to the other tools)
- Transparency - clear instructions, manuscript guidance, fees and policies, peer review prcess, etc.
Check out these links for more on evaluation criteria, standards, and best practices:
Check in these databases to see if the journal is listed in a reputable directory or if it is in Cabell's predatory report. Remember: new journals may or may not be listed - so a lack of inclusion should not be your only determination
If a journal you are considering publishing in is sending up red flags by not meeting these standards, it might be better to consider another place to publish your article. Don't hesitate to talk to your UIW librarians, colleagues, or faculty.