Project proposal

Proposal for evaluating the effectiveness of semaphoric-tangible and virtual reality interfaces for a lo-fi previsualization activity
Joshua Ramsbottom, Katherine Rix, and David Rix
2015 (revision 3)

Abstract

(Problem statement) Animated films like Toy Story (1995) and Inside Out (2015) use digitally rendered 3D assets. The same complex software packages used in production are used to generate previz in pre-production. These software packages (such as Blender and Maya) must be operated by trained animators, who could otherwise be dedicated to production activities. They typically employ deskbound, keyboard-and-mouse, WIMP-based interfaces... We propose two systems that aim to leverage the existing 3D and reality-based skills [Jacob et al. 2008] of an untrained or casual user.

References

  1. Kai Berger, Stephan Meister, Rahul Nair, and Daniel Kondermann. 2013. A state of the art report on Kinect sensor setups in computer vision. In Time-of-Flight and Depth Imaging. Sensors, Algorithms, and Applications (2013), Springer Berlin Heidelberg, 257-272.
  2. Paul J. Besl and Neil D. McKay. 1992. A Method for Registration of 3-D Shapes. IEEE Trans. Pattern Analysis Mach. Intell. 14, 2 (February 1992), 239-256.
  3. Thomas Butkiewicz. 2014. Low-cost coastal mapping using Kinect v2 time-of-flight cameras. Oceans – St. John's (14-19 September 2014), 1-9.
  4. Jeff Butterworth, Andrew Davidson, Stephen Hench, and Marc. T. Olano. 1992. 3DM: A Three Dimensional Modeler Using a Head-mounted Display. In Proceedings of the 1992 Symposium on Interactive 3D Graphics (I3D ’92). ACM, New York, NY, USA, 135–138.
  5. Yang Chen and Gérard Medioni. 1991. Object modeling by registration of multiple range images. In Proceedings of the IEEE International Conference on Robotics and Automation 3, 9-11 (April 1991), 2724-2729.
  6. Christian Collberg, Todd Proebsting, and Alex M. Warren. 2015. Repeatability and benefaction in computer systems research. Technical report 14-04. University of Arizona. 68 pages. Retrieved June 12, 2015 from http://reproducibility.cs.arizona.edu/v2/RepeatabilityTR.pdf
  7. Dror G. Feitelson. 2006. Experimental computer science: the need for a cultural change. Manuscript. Retrieved June 12 2015 from http://www.cs.huji.ac.il/~feit/papers/exp05.pdf
  8. Free Software Foundation. 2007. GNU Affero General Public License. Retrieved June 12, 2015 from https://gnu.org/licenses/agpl.html
  9. Sacha Goedegebure (director). 2008. Big Buck Bunny. Retrieved June 12, 2015 from https://www.youtube.com/watch?v=on21u4BsuK0
  10. Cathleen E. Hughes, Lelin Zhang, Jurgen P. Schulze, Eve Edelstein, and Eduardo Macagno. 2013. CaveCAD: Architectural design in the CAVE. In 2013 IEEE Symposium on 3D User Interfaces (3DUI). 193–194.
  11. Hiroshi Ishii. 2008. The tangible user interface and its evolution. Commun. ACM 51, 6 (June 2008), 32-36.
  12. Robert J.K. Jacob, Audrey Girouard, Leanne M. Hirshfield, Michael S. Horn, Orit Shaer, Erin Treacy Solovey, and Jamie Zigelbaum. 2008. Reality-based interaction: a framework for post-WIMP interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08). ACM, New York, NY, USA, 201-210.
  13. Jelena Kovacevic. 2007. How to encourage and publish reproducible research. In IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2007) 4, IV-1273. IEEE.
  14. Kwegyir (Bilo) Lwabona. 2015. AniTouch: Multitouch-based Collaborative Pre-visualisation for Computer Animation. Master's thesis, work in progress. University of Cape Town, South Africa.
  15. Donald A. Norman. 2010. Natural user interfaces are not natural. interactions 17, 3 (May 2010), 6-10.
  16. Sharon Oviatt. 1999. Ten myths of multimodal interaction. Commun. ACM 42, 11 (November 1999), 74-81.
  17. Sharon Oviatt, Rachel Coulston, and Rebecca Lunsford. 2004. When do we interact multimodally?: cognitive load and multimodal communication patterns. In Proceedings of the 6th international conference on Multimodal interfaces (ICMI '04). ACM, New York, NY, USA, 129-136.
  18. Kyle Orland. 2014. Developer cites motion sickness in delaying Oculus Rift support. Ars Technica (August 21 2014). Retrieved June 12 2015 from http://arstechnica.com/gaming/2014/08/developer-cites-motion-sickness-in-delaying-oculus-rift-support/
  19. Kevin Ponto, Ross Tredinnick, Aaron Bartholomew, Carrie Roy, Dan Szafir, Daniel Greenheck, and Joe Kohlmann. 2013. SculptUp: A rapid, immersive 3D modeling environment. In 2013 IEEE Symposium on 3D User Interfaces (3DUI). 199–200.
  20. Romain Prévost, Emily Whiting, Sylvain Lefebvre, and Olga Sorkine-Hornung. Make it stand: balancing shapes for 3D fabrication. In ACM Transactions on Graphics (SIGGRAPH 2013). 32(4), 81. ACM New York, NY, USA.
  21. Joaquim Salvi, Carles Matabosch, David Fofi, and Josep Forest. 2007. A review of recent range image registration methods with accuracy evaluation. Image Vision Comput. 25, 5 (May 2007), 578-596.
  22. Gregory C. Sharp, Sang W. Lee, and David K. Wehe. 2002. ICP registration using invariant features. IEEE Trans. Pattern Analysis Mach. Intell. 24, 1 (January 2002), 90-102.
  23. Joshua G. Tanenbaum, Amanda M. Williams, Audrey Desjardins, and Karen Tanenbaum. 2013. Democratizing technology: pleasure, utility and expressiveness in DIY and maker practice. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 2603-2612. ACM, 2013.
  24. Jia Wang and Robert Lindeman. 2014. Coordinated 3D Interaction in Tablet- and HMD-based Hybrid Virtual Environments. In Proceedings of the 2nd ACM Symposium on Spatial User Interaction (SUI ’14). ACM, New York, NY, USA, 70–79.