Personal tools
You are here: Home Autonomy Publications

RAD Publications

Working Papers

  • S. Ramamoorthy, M.M.H. Mahmud, B. Rosman, P. Kohli, Latent-variable MDP models for adapting the interaction environment of diverse users, Technical Report, University of Edinburgh, 2013.
      Report

2014

  • S. Albrecht, S. Ramamoorthy, Exploiting causality for efficient monitoring in POMDPs, submitted to the Journal of Artificial Intelligence Research.
      arXiv link
  • M.M.H. Mahmud, M. Hawasly, B. Rosman, S. Ramamoorthy, Clustering Markov Decision Processes for continual transfer, submitted to the Journal of Machine Learning Research.
      arXiv link
  • E. Vafeias, S. Ramamoorthy, Joint classification of actions and object state changes with a latent variable discriminative model, In Proc. IEEE International Conference on Robotics and Automation (ICRA), 2014.  
      Preprint
  • B. Rosman, S. Ramamoorthy, Giving advice to agents with hidden goals, In Proc. IEEE International Conference on Robotics and Automation (ICRA), 2014.  
      Preprint
  • A. Eshky, B. Allison, S. Ramamoorthy, M. Steedman, A generative model for user simulation in a spatial navigation domain, In Proc. Conference of the European Chapter of the Association for Computational Linguistics (EACL), 2014.  
      Preprint
  • B. Rosman, M.M.H. Mahmud, S. Ramamoorthy, P. Kohli, On user behaviour adaptation under interface change, In Proc. International Conference on Intelligent User Interfaces (IUI), 2014.  
      Preprint
  • S. Albrecht, S. Ramamoorthy, On convergence and optimality of best-response learning with policy types in multiagent systems, In Proc. Workshop on Adaptive Learning Agents (ALA), at the International Conference on Autonomous Agents and Multiagent Systems (AAMAS), 2014.
      Preprint

2013

  • I. Havoutis, S. Ramamoorthy, Motion planning and reactive control on learnt skill manifolds, International Journal of Robotics Research 32 (9-10): 1120 - 1150, 2013.  
      Preprint, Publisher's link
  • A. Valtazanos, D.K. Arvind, S. Ramamoorthy, Latent space segmentation for mobile gait analysis, ACM Transactions on Embedded Computing Systems - Special Section on Wireless Health Systems, On-Chip and Off-Chip Network Architectures 12(4) : 101, 2013. 
      Preprint, Publisher's link, Bibtex
  • S. Ramamoorthy, Book review: "S. A. Levin (ed), Games, Groups and the Global Good", J. Operational Research Society 64, 1867, 2013.
      Publisher's link, Bibtex
  • M. Hawasly, S. Ramamoorthy, Lifelong transfer learning with an option hierarchy, In Proc. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2013.
      Preprint, Publisher's link
  •  (The symposium paper below was a preliminary account of the same work.) 
    • M. Hawasly, S. Ramamoorthy, Lifelong learning of structure in the space of policies, In Proc. AAAI Spring Symposium on Lifelong Machine Learning, 2013.
        Preprint, Publisher's link, Bibtex
  • J.D. Mankowitz, S. Ramamoorthy, BRISK-based visual feature extraction for resource constrained robots, In Proc. RoboCup International Symposium, 2013.  
      Preprint, Publisher's link
  • A. Valtazanos, D.K. Arvind, S. Ramamoorthy, Using wearable inertial sensors for posture and position tracking in unconstrained environments through learned translation manifolds, ACM/IEEE Conference on Information Processing in Sensor Networks (IPSN), 2013.  
      Preprint, Publisher's link, Bibtex
  • A. Valtazanos, S. Ramamoorthy, Bayesian interaction shaping: learning to influence strategic interactions in mixed robotic domains, International Conference on Autonomous Agents and Multiagent Systems (AAMAS), 2013.  
      Preprint, Publisher's link, video, Bibtex
  • A. Valtazanos, S. Ramamoorthy, Evaluating the effects of limited perception on interactive decisions in mixed robotic environments, In Proc. ACM/IEEE International Conference on Human-Robot Interaction (HRI), 2013.  
      Preprint, Publisher's link, video, Bibtex
  • S. Albrecht, S. Ramamoorthy, A game-theoretic model and best-response learning method for ad hoc coordination in multiagent systems (Extended Abstract), International Conference on Autonomous Agents and Multiagent Systems (AAMAS), 2013.  
      Preprint, Publisher's link, Bibtex
  •  (The technical report, below, gives a more detailed account of the same material.) 
    • S. Albrecht, S. Ramamoorthy, A game-theoretic model and best-response learning method for ad hoc coordination in multiagent systems, Technical Report, The University of Edinburgh, 2013.
        Report
  • M.M.H. Mahmud, S. Ramamoorthy, Learning in non-stationary MDPs as transfer learning (Extended Abstract), International Conference on Autonomous Agents and Multiagent Systems (AAMAS), 2013.  
      Preprint, Publisher's link, Bibtex
  •  (The technical report, below, gives a more detailed account of the same material.) 
    • M. M. H. Mahmud, S. Ramamoorthy, Learning in non-stationary MDPs as transfer learning, Technical Report, The University of Edinburgh, 2013.
        Report

2012

  • B. Rosman, S. Ramamoorthy, What good are actions? Accelerating learning using learned action priors, In Proc. International Conference on Development and Learning (ICDL-EpiRob), 2012.  [Paper of Excellence Award]
      Preprint, Publisher's link
  • S. Albrecht, S. Ramamoorthy, Comparative evaluation of MAL algorithms in a diverse set of ad hoc team problems, In Proc. International Conference on Autonomous Agents and Multiagent Systems (AAMAS), 2012.
      Preprint, Publisher's link, Bibtex
  • M. Leonetti, L. Iocchi, S. Ramamoorthy, Induction and learning of finite-state controllers from simulation (Extended Abstract), In Proc. International Conference on Autonomous Agents and Multiagent Systems (AAMAS), 2012.
      Preprint, Publisher's link, Bibtex
  • M. Hawasly, S. Ramamoorthy, Task variability in autonomous robots: Offline learning for online performance, In Proc. Int. Workshop on Evolutionary and Reinforcement Learning for Autonomous Robot Systems (ERLARS), 2012. 
      Preprint
  • S. Ramamoorthy, A. Salamon, R. Santhanam, Macroscopes: models for collective decision making, In Proc. Collective Intelligence, 2012.
      Preprint, Publisher's link
  • B. Rosman, S. Ramamoorthy, A multitask representation using reusable local policy templates, In Proc. AAAI Spring Symposium on Designing Intelligent Robots: Reintegrating AI, 2012.
      Preprint, Publisher's link

2011

  • B. Rosman, S. Ramamoorthy, Learning spatial relationships between objectsInternational Journal of Robotics Research, 2011.
      Preprint, Publisher's link, Bibtex
  • T. Larkworthy, S. Ramamoorthy, A characterization of the reconfiguration space of self-reconfiguring robotic systemsRobotica (Special Issue on Self-X Systems) Volume 29, Special Issue 1, pp. 73-85, 2011.
      Preprint, Publisher's link, Bibtex
  • A. Valtazanos, S. Ramamoorthy, Intent inference and strategic escape in multi-robot games with physical limitations and uncertainty, In Proc. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2011.
      Preprint, Publisher's link, Bibtex
  • M. Leonetti, L. Iocchi, S. Ramamoorthy, Reinforcement learning through global stochastic search in N-MDPs, In Proc. European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML PKDD), 2011. 
      Preprint, Publisher's link, Bibtex
  • M. Leonetti, L. Iocchi, S. Ramamoorthy, Learning finite state controllers from simulation, In Proc. European Workshop on Reinforcement Learning (EWRL-9), 2011.
      Workshop link
  • A. Valtazanos, S. Ramamoorthy, Online motion planning for multi-robot interaction using composable reachable sets. In Proc. RoboCup International Symposium, 2011.
      Preprint
  • A. Valtazanos, S. Ramamoorthy, NaOISIS: A 3-D behavioural simulator for the NAO humanoid robot. In Proc. RoboCup International Symposium, 2011.
      Preprint
  • S. Ramamoorthy, Book review: "B. Øksendal, A. Sulem, Applied Stochastic Control of Jump Diffusions", J. Operational Research Society 62: 246 - 250, 2011.
      Preprint, Publisher's link, Bibtex

2010

  • I. Havoutis, S.Ramamoorthy, Constrained geodesic trajectory generation on learnt skill manifolds. In Proc. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2010. [Finalist, RoboCup Best Paper Award]
      Preprint, Publisher's link
  • E. Ho, T. Komura, S. Ramamoorthy, S. Vijayakumar, Controlling humanoid robots in topology coordinates. In Proc. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2010.
      Preprint, Publisher's link
  • A. Valtazanos, D.K. Arvind, S. Ramamoorthy, Comparative study of segmentation of periodic motion data for mobile gait analysis. In Proc. Wireless Health Conference, 2010.
      Preprint, Publisher's link
  • B. Rosman, S. Ramamoorthy, A game theoretic procedure for learning hierarchically structured strategies. In Proc. IEEE International Conference on Robotics and Automation (ICRA), 2010.
      Preprint, Publisher's link
  • I. Havoutis, S. Ramamoorthy, Geodesic trajectory generation on learnt skill manifolds. In Proc. IEEE International Conference on Robotics and Automation (ICRA), 2010.
      Preprint, Publisher's link
  • T. Larkworthy, S. Ramamoorthy, An efficient algorithm for self-reconfiguration planning in a modular robot. In Proc. IEEE International Conference on Robotics and Automation (ICRA), 2010.
      Preprint, Publisher's link
  • M. Leonetti, S. Ramamoorthy, A heuristic strategy for learning in partially observable and non-Markovian domains, In Proc. International Workshop on Evolutionary and Reinforcement Learning for Autonomous Robot Systems (ERLARS 2010).
       Preprint, Workshop link
  • T. Larkworthy, S. Ramamoorthy, Graph minor analysis of reconfiguring state spaces, In Proc. Workshop on Modular Robotics: State of the Art, IEEE International Conference on Robotics and Automation, 2010.
      Workshop link

2009

  • T. Larkworthy, G.M. Hayes, S. Ramamoorthy, General motion planning methods for self-reconfiguration planning. In Proc. Towards Autonomous Robotic Systems, 2009.
  • I. Havoutis, S. Ramamoorthy, Motion synthesis through randomized exploration on submanifolds in configuration space. In J. Baltes et al. (Eds.): RoboCup 2009, Lecture Notes in Artificial Intelligence, Volume 5949, pp. 92-103. Springer Verlag, Heidelberg (2010).
      Preprint, Publisher's link
  • S. Ramamoorthy, L. Wenzel, J. Nagle, B. Wang, M. Cerna, A differential geometric approach to discrete-coefficient filter design. In Proc. IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2009.
      Publisher's link, Bibtex
  • I. Havoutis, S. Ramamoorthy, Geodesic trajectory generation on learnt skill manifolds, Modeling, Simulation and Optimization of Bipedal Walking Workshop, IEEE-RAS International Conference on Humanoid Robots, 7 Dec. 2009.
      Preprint, Workshop link
  • H. Mlnařík, S. Ramamoorthy, R. Savani, Multi-strategy trading utilizing market regimes, Advances in Machine Learning for Computational Finance Workshop, London, 20-21 July 2009.
      Preprint, Workshop link, Slides and Video
      [Slightly modified presentation from the Stats in the Château workshop, whose proceedings are available as P. Alquier, E. Gautier, G. Stoltz (Eds.), Inverse Problems and High-Dimensional Estimation, Lecture Notes in Statistics Vol. 203, Springer 2011]

2008

  • S. Ramamoorthy, R. Rajagopal, L. Wenzel, Efficient, incremental coverage of space with a continuous curve. Robotica (Special Issue on Geometry in Robotics), Vol. 26, pp. 503-512, 2008.
      Publisher's link, Bibtex
  • R. Rajagopal, S. Ramamoorthy, L. Wenzel, H. Andrade, A rapid prototyping tool for embedded, real time hierarchical control systems. EURASIP Journal on Embedded Systems, Article ID 162747, 2008.
       Publisher's link
  • S. Ramamoorthy, B.J. Kuipers, Trajectory generation for dynamic bipedal walking through qualitative model based manifold learning. In Proc. IEEE International Conference on Robotics and Automation (ICRA), pp. 359-366, 2008. [Finalist, Best Conference Paper Award - Top 4 from 661 Accepted Papers]
      Preprint
  • S. Ramamoorthy, G.M. Hayes (Eds.), Towards Autonomous Robotic Systems (TAROS 2008), ISBN 978 1 906849 00 9.

2007

2006 and earlier

 

Patents

  • J.M. Lewis, M.D. Cerna, K.P. Gupton, J.C. Nagle, Y. Rao, S. Ramamoorthy, D.R. Schmidt, B.R. Weidman, L. Wenzel, N. Zhang, B. Wang, Approximating a system using an abstract geometrical space, US patent 8364446, January 29, 2013.
  • S. Ramamoorthy, L. Wenzel, G.O. Morrow, M.L. Santori, J.C. Limroth, R. Kudukoli, R.E. Dye, Automatically generating a second graphical program based on a first graphical program, US patent 8205188, June 19, 2012.
  • S. Ramamoorthy, L. Wenzel, G.O. Morrow, M.L. Santori, J.C. Limroth, R. Kudukoli, R.E. Dye, Converting a first graphical program into an intermediate abstract representation for new graphical program generation, US patent 8146007, March 27, 2012.
  • D. Nair, M.S. Fisher, S.V. Kumar, B. Smyth, S. Ramamoorthy, Geometric pattern matching using dynamic feature combinations, US patent 7340089, March 4, 2008.
  • S. Ramamoorthy, L. Wenzel, G.O. Morrow, M.L. Santori, J.C. Limroth, R. Kudukoli, R.E. Dye, System and method for programmatically generating a second graphical program based on a first graphical program, US patent 7340684, March 4, 2008. 
  • L. Wenzel, S. Ramamoorthy, G.O. Morrow, M.L. Santori, J.C. Limroth, R. Kudukoli, R.E. Dye, System and method for programmatically generating a second graphical program based on a first graphical program, US patent 7043693, May 9, 2006.
  • S. Ramamoorthy, J.S. Falcon, Automatic tuning of motion controllers using search techniques, US patent 7035694, April 25, 2006..
Document Actions