Mosaicode and the visual programming of web application for music and multimedia

Autores

DOI:

https://doi.org/10.5216/mh.v18i1.53577

Palavras-chave:

Webaudio, Mosaicode, Visual programming, Language, Specific domain (programming) languages, Graphical Programming environment

Resumo

The development of audio application demands a high knowledge about this application domain, traditional program- ming logic and programming languages. It is possible to use a Visual Programming Language to ease the application development, including experimentations and creative exploration of the language. In this paper we present a Visual Programming Environment to create Web Audio applications, called Mosaicode. Different from other audio creation platforms that use a visual approach, our environment is a source code generator based on code snippets to create complete applications.

 

Downloads

Não há dados estatísticos.

Biografia do Autor

Flávio Luiz Schiavoni, Universidade Federal de São João del-Rei São João del-Rei, Minas Gerais, Brasil, fls@ufsj.edu.br

Luan Luiz Gonçalves, Universidade Federal de São João del-Rei São João del-Rei, Minas Gerais, Brasil, luanlg.cco@gmail.com

José Mauro da Silva Sandy, Universidade Federal de São João del-Rei São João del-Rei, Minas Gerais, Brasil, jmsandy@gmail.com

http://lattes.cnpq.br/5849035895177823

Referências

CAMURRI, A.; HASHIMOTO, S.; RICCHETTI, M.; RICCI, A.; SUZUKI, K.; TROCCA, R.; VOL- PE, G. Eyesweb: Toward gesture and affect recognition in interactive dance and music systems. Computer Music Journal, 24(1), 57-69, 2000.

CLARK, C. B.; TINDALE, A. Flocking: a framework for declarative music-making on the Web. In SMC Conference and Summer School, 1550-1557, 2014.

DANKS, M. Real-time Image and Video Processing in GEM. In International Computer Music Conference, Thessaloniki, 1997.

GAMMA, E. Design patterns: elements of reusable object-oriented software. Pearson Education India, 1995.

GARTON, B.; TOPPER, D. RTcmix-Using CMIX in Real Time. In International Computer Music Conference, Thessaloniki. 1997.

GOMES, A.; HENRIQUES, J.; MENDES, A. Uma proposta para ajudar alunos com dificuldades na aprendizagem inicial de programação de computadores. Educação, Formação & Tecnologias, 1(1), 93-103, 2008. (ISSN 1646-933X)

GRONBACK, R. C. Eclipse modeling project: a domain-specific language (DSL) toolkit. Pearson Education, 2009.

HAEBERLI, P. E. ConMan: a visual programming language for interactive graphics. In ACM Si- gGraph Computer Graphics, 22 (4), 103-111, 1988.

HILS, D. D. Visual languages and computing survey: Data flow visual programming languages. Journal of Visual Languages & Computing, 3(1), 69-101, 1992.

LANSKY, P. Cmix release notes and manuals. Department of Music, Princeton University. Prin- ceton, New Jersey: Princeton University, 1990.

LAZZARINI, V.; COSTELLO, E.; YI, S. Csound on the Web. Csound conference. University of Bath, 2014.

LETZ, S.; DENOUX, S.; ORLAREY, Y.; FOBER, D. Faust audio DSP language in the Web. In Pro- ceedings of the Linux Audio Conference (LAC-15), Mainz, Germany, 2015.

MAHADEVAN, A.; FREEMAN, J.; MAGERKO, B. An interactive, graphical coding environment for EarSketch online using Blockly and Web Audio API. Web Audio Conference WAC-2016, April 4–6. Atlanta, GA: Georgia Institute of Technology, 2016.

MATHEWS, M. V. The digital computer as a musical instrument. Science, 142(3592), 553-557, 1963. MCCARTNEY, J. Rethinking the computer music language: SuperCollider. Computer Music

Journal, 26(4), 61-68, 2002.

MERNIK, M.; HEERING, J.; SLOANE, A. M. When and how to develop domain-specific langua-

ges. ACM computing surveys (CSUR), 37(4), 316-344, 2005.

MOORE, F. R. Elements of computer music. New Jersey: Prentice-Hall, 1990.

ORLAREY, Y.; FOBER, D.; LETZ, S. FAUST: an efficient functional approach to DSP program- ming. New Computational Paradigms for Computer Music, 1-33, 2009.

POPE, S. T. Machine tongues XV: Three packages for software sound synthesis. Computer Mu- sic Journal, 17(2), 23-54, 1993.

PUCKETTE, M. Pure Data: another integrated computer music environment. Proceedings of the second intercollege computer music concerts, 37-41, 1996.

PUCKETTE, M.; ZICARELLI, D. MAX-An interactive graphic programming environment. Op- code Systems, Menlo Park, CA. 1990.

REAS, C.; FRY, B. Processing: programming for the media arts. AI & SOCIETY, 20(4), 526-538, 2006.

RESIG, J.; FRY, B., REAS, C. Processing.js [Visual programming language], 2008. http://proces- singjs.org/

ROBERTS, C.; WAKEFIELD, G.; WRIGHT, M. The Web Browser As Synthesizer And Interface. In International Conference on New Interfaces for Musical Expression, 313-318, 2013.

ROBERTS, C.; WAKEFIELD, G.; WRIGHT, M.; KUCHERA-MORIN, J. Designing musical instru- ments for the browser. Computer Music Journal, 39(1), 27-40, 2015.

ROBERTS, C.; WRIGHT, M.; KUCHERA-MORIN, J.; HÖLLERER, T. Gibber: Abstractions for creative multimedia programming. In Proceedings of the 22nd ACM international conference on Multimedia (pp. 67-76). New York: ACM, 2014.

SCHIAVONI, F. L.; GONCALVES, L. L. From Virtual Reality to Digital Arts with Mosaicode. In Proceedings of the 19th Symposium on Virtual and Augmented Reality (SVR 2017) (pp. 200-206), 2017.

SCHIAVONI, F. L.; GONCALVES, L. L. Teste de usabilidade do sistema Mosaicode. In: Anais do IV Workshop de Iniciação Científica em Sistemas de Informação (WICSI). Lavras, MG: Universi- dade Federal de Lavras, p. 5–8, 2017.

TAYLOR, B.; ALLISON, J. BRAID: A web audio instrument builder with embedded code blocks. In Proceedings of the 1st international Web Audio Conference, 2015.

TROWER, J.; GRAY, J. Blockly language creation and applications: Visual programming for me- dia computation and bluetooth robotics control. In Proceedings of the 46th ACM Technical Sym- posium on Computer Science Education, 5-5, New York: ACM, 2015.

VERCOE, B. CSound manual. Cambridge, MA: Media Lab, 1986.

WILSON, C., KALLIOKOSKI, J. Web MIDI API. on W3C Working Draft 17 March 2015, Available

on: https://www.w3.org/TR/webmidi/. Accessed: 2017-09-30.

WYSE, L.; SUBRAMANIAN, S. The viability of the web browser as a computer music platform.

Computer Music Journal, 37(4), 10-23, 2013.

Publicado

2018-06-19

Como Citar

LUIZ SCHIAVONI, F.; LUIZ GONÇALVES, L.; MAURO DA SILVA SANDY, J. Mosaicode and the visual programming of web application for music and multimedia. Música Hodie, Goiânia, v. 18, n. 1, p. 132–146, 2018. DOI: 10.5216/mh.v18i1.53577. Disponível em: https://revistas.ufg.br/musica/article/view/53577. Acesso em: 23 abr. 2024.

Edição

Seção

Artigos