I would vote for finetuning, prompt engineering, rather than only add domain specific knowledge. Others are playing detective ,digging into the ethical conundrums of AI-generated content.