To create a new BibTeX style, run
latex makebst.tex
to proceed through a long list of questions about the style. The result is another file that will produce a .bst file after running it through LaTeX again. If you change your mind about an answer, you can edit the intermediate file, it has pretty obvious format.
Check this post for more information about .bst files.