John N. Tsitsiklis – publications

Book chapters

1. Error Exponents for Decentralized Detection in Tree Networks.   W. P. Tay and J. N. Tsitsiklis;
   in Networked Sensing Information and Control, V. Saligrama (Ed.), Springer Verlag, 2008, pp. 73-92.

2. A Game Theoretic View of Efficiency Loss in Resource Allocation.   R. Johari and J. N. Tsitsiklis;
   in Advances in Control, Communication Networks, and Transportation Systems: In Honor of Pravin Varaiya,
   E. H. Abed (Ed.), Systems and Control: Foundations and Applications Series, Birkhauser, Boston, 2005, pp. 203-223.

3. Decentralized Detection.   J. N. Tsitsiklis;
   in Advances in Signal Processing, Vol. 2, H. V. Poor and J. B. Thomas, editors, JAI Press, 1993, pp. 297-344.

Preprints and recent conference papers

1. Jumping Fluid Models and Delay Stability of Max-Weight Dynamics under Heavy-Tailed Traffic
   A. Sharifnassab and J. N. Tsitsiklis
   submitted, November 2021.

Journal papers

1. Stability, Memory, and Messaging Tradeoffs in Heterogeneous Service Systems
   D. Gamarnik, J. N. Tsitsiklis, and M. Zubeldia
   Mathematics of Operations Research, 2021

2. Private Sequential Learning
   J. N. Tsitsiklis, K. Xu, and Z. Xu
   Operations Research, Vol. 69, No. 5, 2021, pp. 1575-1590.
   Extended abstract in COLT 2018.

3. Blind Identification of Stochastic Block Models from Dynamical Observations [final version]
   M. T. Schaub, S. Segarra, and J. N. Tsitsiklis
   SIAM J. on Mathematics of Data Science, Vol. 2, No. 2, 2020, pp. 335-367.

4. Fluctuation Bounds for the Max-Weight Policy, with Applications to State Space Collapse
   A. Sharifnassab, J. N. Tsitsiklis, and S. J. Golestani
   Stochastic Systems, Vol. 10, No. 3, September 2020, pp. 223-250.

5. A Lower Bound on the Queueing Delay in Resource Constrained Load Balancing
   D. Gamarnik, J. N. Tsitsiklis, and M. Zubeldia
   The Annals of Applied Probability, Vol. 30, No. 2, 2020, pp. 870–901.

6. Sensitivity to Cumulative Perturbations for a Class of Piecewise Constant Hybrid Systems [ final version ]
   A. Sharifnassab, J. N. Tsitsiklis, and S. J. Golestani
   IEEE Transactions on Automatic Control, Vol. 65, No.3, March 2020, pp. 1057-1072.

7. Delay Analysis of the Max-Weight Policy under Heavy-Tailed Traffic via Fluid Approximations
   M. G. Markakis, E. Modiano, and J. N. Tsitsiklis
   Mathematics of Operations Research, Vol. 43, No. 2, May 2018, pp. 460-493.

8. Delay-Predictability Trade-offs in Reaching a Secret Goal
   J. N. Tsitsiklis and K. Xu
   Operations Research, Vol. 66, No. 2, March-April 2018, pp. 587-596.

9. Delay, Memory, and Messaging Tradeoffs in Distributed Service Systems
   D. Gamarnik, J. N. Tsitsiklis, and M. Zubeldia
   Stochastic Systems, Vol. 8, No. 1, March 2018, pp. 45–74.

10. Flexible Queueing Architectures [supplement]
    J. N. Tsitsiklis and K. Xu
    Operations Research, September-October 2017, Vol. 65, No. 5, pp. 1115-1428

11. When is a network epidemic hard to eliminate?
    K. Drakopoulos, A. Ozdaglar, and J. N. Tsitsiklis
    Mathematics of Operations Research, Vol. 42, No. 1, February 2017, pp. 1–14.

12. On Queue-Size Scaling for Input-Queued Switches
    D. Shah, J. N. Tsitsiklis, and Y. Zhong
    Stochastic Systems, Vol. 6, No. 1, 2016, pp. 1-25.

13. Delay Stability of Back-Pressure Policies in the presence of Heavy-Tailed Traffic  
    M. G. Markakis, E. Modiano, and J. N. Tsitsiklis
    IEEE/ACM Transactions on Networking, Vol. 24, No. 4, 2016, pp. 2046-2059.

14. Coordination with Local Information  
    M. Dahleh, A. Tahbaz-Salehi, J. N. Tsitsiklis, and S. Zoumpoulis
    Operations Research, Vol. 64, No. 3, May-June 2016, pp. 622-637.

15. Optimization of Radiation Therapy Fractionation Schedules in the Presence of Tumor Repopulation  
    T. Bortfeld, J. Ramakrishnan, J. N. Tsitsiklis, and J. Unkelbach
    INFORMS J. on Computing, Vol. 27, No. 4, Fall 2015, pp. 788-803.

16. The Value of Field Experiments   [e-companion] [codes]
    J. Li, P. Rusmevichientong, D. Simester, J. N. Tsitsiklis, and S. Zoumpoulis
    Management Science, Vol. 61, No. 7, July 2015, pp. 1722-1740.

17. Pricing of Fluctuations in Electricity Markets  [supplement]
    J. N. Tsitsiklis and Y. Xu
    European Journal of Operations Research, Vol. 246, No. 1, October 2015, pp. 199–208.

18. An efficient curing policy for epidemics on graphs 
    K. Drakopoulos, A. Ozdaglar, and J. N. Tsitsiklis
    IEEE Transactions on Network Science and Engineering, Vol. 1, No. 2, July-December 2014, pp. 67-75.

19. Efficiency Loss in a Cournot Oligopoly with Convex Market Demand  
    J. N. Tsitsiklis and Y. Xu
    Journal of Mathematical Economics, Vol. 53, 2014, August 2014, pp. 46-58.

20. Allocational flexibility in constrained supply chains  
    N. Sabbaghi, Y. Sheffi, and J. N. Tsitsiklis
    International Journal of Production Economics, Vol. 153, 2014, July 2014, pp. 86-94.

21. Throughput Optimal Scheduling Over Time-Varying Channels in the Presence of Heavy-Tailed Traffic  
    K. P. Jagannathan, M. Markakis, E. Modiano, and J. N. Tsitsiklis
    IEEE Transactions on Information Theory, Vol. 60, No. 5, May 2014, pp. 2896-2909.

22. Qualitative Properties of alpha-Fair Policies in Bandwidth-Sharing Networks
    D. Shah, J. N. Tsitsiklis, and Y. Zhong
    The Annals of Applied Probability, Vol. 24, No. 1, February 2014, pp. 76-113.

23. Max-Weight Scheduling in Queueing Networks with Heavy-Tailed Traffic
    M. G. Markakis, E. Modiano, and J. N. Tsitsiklis
    IEEE/ACM Transactions on Networking, Vol. 22, No. 1, February 2014, pp. 257-270.

24. Degree Fluctuations and the Convergence Time of Consensus Algorithms
    A. Olshevsky, and J. N. Tsitsiklis
    IEEE Transactions on Automatic Control, Vol. 58, No. 10, October 2013, pp. 2626-2631.

25. On Learning with Finite Memory
    K. Drakopoulos, A. Ozdaglar, and J. N. Tsitsiklis
    IEEE Transactions on Information Theory, Vol. 59, No. 10, October 2013, pp. 6859-6872.

26. Algorithmic Aspects of Mean-Variance Optimization in Markov Decision Processes
    S. Mannor and J. N. Tsitsiklis
    European Journal of Operational Research, Vol. 231, 2013, pp. 645-653.

27. Profit Loss in Cournot Oligopolies   [extended version]
    J. N. Tsitsiklis and Y. Xu
    Operations Research Letters, Vol. 41, 2013, pp. 415-420.

28. NP-hardness of Deciding Convexity of Quartic Polynomials and Related Problems
    A. A. Ahmadi, A. Olshevsky, P. A. Parrilo, J. N. Tsitsiklis
    Mathematical Programming, Ser. A, Vol. 137, No. 1-2, February 2013, pp. 453-476.

29. Properties of cell death models calibrated and compared using Bayesian approaches   [supplementary material]
    H. Eydgahi, W. W. Chen, J. L. Muhlich, D. Vitkup, J. N. Tsitsiklis, and P. K. Sorger
    Molecular Systems Biology, Vol. 9, article 644, February 2013, pp. 1-17 (electronic).

30. Convergence of Type-Symmetric and Cut-Balanced Consensus Seeking Systems   [extended version]
    J. M. Hendrickx and J. N. Tsitsiklis
    IEEE Transactions on Automatic Control, Vol. 58, No. 1, January 2013, pp. 214-218.

31. On the Power of (Even a Little) Resource Pooling  [correction]
    J. N. Tsitsiklis and K. Xu
    Stochastic Systems, Vol. 2, 2012, pp. 1-66.

32. Queue Length Asymptotics for Generalized Max-Weight Scheduling in the Presence of Heavy-Tailed Traffic"
    K. Jagannathan, M. Markakis, E. Modiano, and J. N. Tsitsiklis
    IEEE/ACM Transactions on Networking, Vol. 20, No. 4, August 2012, pp. 1096-1111.

33. A Dynamic Programming Approach to Adaptive Fractionation
    J. Ramakrishnan, D. Craft, T. Bortfeld, and J. N. Tsitsiklis
    Physics in Medicine and Biology, Vol. 57, No. 5, 2012, pp. 1203-1216.

34. Hardness of Low Delay Network Scheduling
    D. Shah, D. N. C. Tse, and J. N. Tsitsiklis
    IEEE Transactions on Information Theory, Vol. 57, No. 12, December 2011, pp. 7810-7818.

35. A Lower Bound for Distributed Averaging Algorithms on the Line Graph
    A. Olshevsky and J. N. Tsitsiklis
    IEEE Transactions on Automatic Control, Vol. 56, No. 11, November 2011, pp. 2694-2698.

36. Distributed Anonymous Discrete Function Computation and Averaging  [extended version]
    J. M. Hendrickx, A. Olshevsky, and J. N. Tsitsiklis
    IEEE Transactions on Automatic Control, Vol. 56, No. 10, October 2011, pp. 2276-2289.

37. Parameterized Supply Function Bidding: Equilibrium and Efficiency
    R. Johari and J. N. Tsitsiklis
    Operations Research, Vol. 59, No. 5, September-October 2011, pp. 1079-1089.

38. Convergence Speed in Distributed Consensus and Averaging
    A. Olshevsky and J. N. Tsitsiklis
    SIAM Review, Vol. 53, No. 4, 2011, pp. 747-772.

39. Optimal Scaling of Average Queue Sizes in an Input-Queued Switch: an Open Problem
    D. Shah, J. N. Tsitsiklis, Y. Zhong
    Queueing Systems: Theory and Applications, Vol. 68, No. 3-4, August 2011, pp. 375-384.

40. On Decentralized Detection with Partial Information Sharing among Sensors
    O. P. Kreidl, J. N. Tsitsiklis, and S. Zoumpoulis,
    IEEE Transactions on Signal Processing, Vol. 59, No. 4, 2011, pp. 1759-1765.

41. Continuous-Time Average-Preserving Opinion Dynamics with Opinion-Dependent Communications  [supplement ]
    V. D. Blondel, J. M. Hendrickx, and J. N. Tsitsiklis
    SIAM Journal on Control and Optimization, Vol. 48, No. 8, 2010, pp. 5214-5240.
    

42. Linearly Parameterized Bandits   [extended version]
    P. Rusmevichientong, and J. N. Tsitsiklis
    Mathematics of Operations Research, Vol. 35, No. 2, May 2010, pp. 395-411.

43. When is it Important to Know You've Been Rejected? A Search Problem with Probabilistic Appearance of Offers
    S. Das and J. N. Tsitsiklis
    Journal of Economic Behavior and Organization, Vol. 74, No. 1-2, 2010, pp. 104-122.

44. Perspectives on Stochastic Optimization Over Time
    J. N. Tsitsiklis
    INFORMS Journal on Computing, Vol. 22, No. 1, 2010, pp. 18-19.

45. Optimal Margin and Edge-Enhanced Intensity Maps in the Presence of Motion and Uncertainty"
    T. C. Y. Chan, J. N. Tsitsiklis, and T. Bortfeld
    Physics in Medicine and Biology, Vol. 55, No. 2, 2010, pp. 515-533.

46. A Structured Multiarmed Bandit Problem and the Greedy Policy
    A. J. Mersereau, P. Rusmevichientong, and J. N. Tsitsiklis
    IEEE Transactions on Automatic Control, Vol. 54, No. 12, December 2009, pp. 2787-2802.

47. On Krause's Multi-Agent Consensus Model with State-Dependent Connectivity  [extended version]
    V. D. Blondel, J. M. Hendrickx, and J. N. Tsitsiklis
    IEEE Transactions on Automatic Control, Vol. 54, No. 11, November 2009, pp. 2586-2597.

48. On Distributed Averaging Algorithms and Quantization Effects
    A. Nedic, A. Olshevsky, A. Ozdaglar, and J. N. Tsitsiklis
    IEEE Transactions on Automatic Control, Vol. 54, No. 11, November 2009, pp. 2506-2517.

49. Bayesian Detection in Bounded Height Tree Networks
    W. P. Tay, J. N. Tsitsiklis, and M. Z. Win
    IEEE Transactions on Signal Processing, Vol. 57, No. 10, October 2009, pp. 4042-4051.

50. Efficiency of Scalar-Parameterized Mechanisms  [electronic companion]
    R. Johari and J. N. Tsitsiklis
    Operations Research, Vol. 57, No. 4, July-August 2009, pp. 823-839.

51. Approachability in Repeated Games: Computational Aspects and a Stackelberg Variant
    S. Mannor and J. N. Tsitsiklis
    Games and Economic Behavior, Vol. 66, No. 1, 2009, pp. 315-325.

52. Online Learning with Sample Path Constraints,
    S. Mannor, J. N. Tsitsiklis, and J. Y. Yu
    Journal of Machine Learning Research, Vol. 10, March 2009, pp. 569-590.

53. Convergence Speed in Distributed Consensus and Averaging"
    A. Olshevsky and J. N. Tsitsiklis
    SIAM Journal on Control and Optimization, Vol. 48, No. 1, 2009, pp. 33-55.

54. Bin Packing with Queues,
    D. Shah and J. N. Tsitsiklis
    Journal of Applied Probability, Vol. 45, No. 4, December 2008, pp. 922-939.

55. On the Nonexistence of Quadratic Lyapunov Functions for Consensus Algorithms
    A. Olshevsky and J. N. Tsitsiklis
    IEEE Transactions on Automatic Control, Vol. 53, No. 11, December 2008, pp. 2642-2645.

56. Robust Management of Motion Uncertainty in Intensity-Modulated Radiation Therapy
    T. Bortfeld, T. C. Y. Chan, A. Trofimov, and J. N. Tsitsiklis
    Operations Research, Vol. 56, No. 6, November-December 2008, pp. 1461-1473.

57. A Single-Unit Decomposition Approach to Multi-Echelon Inventory Systems   [electronic companion]
    A. Muharremoglu and J. N. Tsitsiklis
    Operations Research, Vol. 56, No. 5, September-October 2008, pp. 1089-1103. .

58. On the Sub-exponential Decay of Detection Error Probabilities in Long Tandems
    W. P. Tay, J. N. Tsitsiklis, and M. Z. Win
    IEEE Transactions on Information Theory, Vol. 54, No. 10, October 2008, pp. 4767-4771.

59. Data Fusion Trees for Detection: Does Architecture Matter?
    W. P. Tay, J. N. Tsitsiklis, and M. Z. Win
    IEEE Transactions on Information Theory, Vol. 54, No. 9, September 2008, pp. 4155-4168.

60. On the Impact of Node Failures and Unreliable Communications in Dense Sensor Networks
    W. P. Tay, J. N. Tsitsiklis, and M. Z. Win
    IEEE Transactions on Signal processing, Vol. 56, No. 6, June 2008, pp. 2535-2546.

61. Asymptotic Performance of a Censoring Sensor Network
    W. P. Tay, J. N. Tsitsiklis, and M. Z. Win
    IEEE Transactions on Information Theory, Vol. 53, No. 11, pp. 4191-4209, November 2007.

62. Stochastic Search in a Forest Revisited
    J. Sethuraman and J. N. Tsitsiklis
    Mathematics of Operations Research, Vol. 32, No. 3, August 2007, pp. 589-593.

63. Comment on "Coordination of Groups of Mobile Autonomous Agents Using Nearest Neighbor Rules"
    D. P. Bertsekas and J. N. Tsitsiklis
    IEEE Transactions on Automatic Control, Vol. 52, No. 5, May 2007, pp. 968-969.

64. NP-Hardness of Checking the Unichain Condition in Average Cost MDPs
    J. N. Tsitsiklis
    Operations Research Letters, Vol. 35, No. 3, May 2007, pp. 319-323.

65. Optimal Transmission Scheduling in Symmetric Communication Models with Intermittent Connectivity
    A. Ganti, E. Modiano, and J. N. Tsitsiklis
    IEEE Transactions on Information Theory, Vol. 5, No. 3, March 2007, pp. 998-1008.

66. Bias and Variance Approximation in Value Function Estimates  [appendix]
    S. Mannor, D. I. Simester, P. Sun, and J. N. Tsitsiklis
    Management Science, Vol. 53, No. 2, February 2007, pp. 308-322

67. A Contract-Based Model for Directed Network Formation
    R. Johari, S. Mannor, and J. N. Tsitsiklis
    Games and Economic Behavior, Vol. 56, 2006, pp. 201-224.

68. A Scalable Network Resource Allocation Mechanism with Bounded Efficiency Loss
    R. Johari and J. N. Tsitsiklis
    IEEE JSAC Special issue: Price-Based Access Control and Economics for Communication Networks, Vol. 24, No. 5, May 2006, pp. 992-999. Expanded version: "Efficiency Loss in Cournot Games," technical report LIDS-P-2639, LIDS, MIT, January 2005.

69. Dynamic Catalog Mailing Policies
    D. I. Simester, P. Sun, and J. N. Tsitsiklis
    Management Science, Vol. 52, No. 5, May 2006, pp. 683-696.

70. A Robust Approach to IMRT Optimization
    T. C. Y. Chan, T. Bortfeld, and J. N. Tsitsiklis
    Physics in Medicine and Biology, Vol. 51, 2006, pp. 2567-2583.

71. Optimal Transmission Scheduling over a Fading Channel with Energy and Deadline Constraints
    A. Fu, E. Modiano, and J. N. Tsitsiklis
    IEEE Transactions on Wireless Communications, Vol. 5, No. 3, March 2006, pp. 630-641.

72. Efficiency Loss in a Network Resource Allocation Game: The Case of Elastic Supply
    R. Johari, S. Mannor, and J. N. Tsitsiklis
    IEEE Transactions on Automatic Control, Vol. 50, No. 11, November 2005, pp. 1712-1724.
    expanded version, technical report LIDS-P-2605, June 2004.

73. On the Empirical State-Action Frequencies in Markov Decision Processes Under General Policies
    S. Mannor and J. N. Tsitsiklis
    Mathematics of Operations Research, Vol. 30, No. 3, August 2005, pp. 545-561.

74. Efficiency Loss in a Network Resource Allocation Game,
    R. Johari and J. N. Tsitsiklis
    Mathematics of Operations Research, Vol. 29, No. 3, August 2004, pp. 407-435.

75. The Sample Complexity of Exploration in the Multi-Armed Bandit Problem,
    S. Mannor and J. N. Tsitsiklis,
    Journal of Machine Learning Research, Vol. 5, June 2004, pp. 623-648.

76. Convergence Rate of Linear Two-Time Scale Stochastic Approximation
    V. R. Konda and J. N. Tsitsiklis
    The Annals of Applied Probability, Vol. 14, No. 2, 2004, pp. 796-819.

77. Actor-Critic Algorithms  [appendix]
    V. R. Konda and J. N. Tsitsiklis
    SIAM Journal on Control and Optimization, Vol. 42, No. 4, 2003, pp. 1143-1166.

    Preliminary version in NIPS 1999.

78. Optimal Energy Allocation and Admission Control for Communications Satellites
    A. Fu, E. Modiano, and J. N. Tsitsiklis
    IEEE/ACM Transactions on Networking, Vol. 11, No. 3, June 2003, pp. 488-500.

79. Linear Stochastic Approximation Driven by Slowly Varying Markov Chains
    V. R. Konda and J. N. Tsitsiklis
    Systems and Control Letters, Vol. 50, No. 2, 2003, pp. 95-102.

80. Approximate Gradient Methods in Policy-Space Optimization of Markov Reward Processes
    P. Marbach and J. N. Tsitsiklis
    Journal of Discrete Event Dynamical Systems, Vol. 13, pp. 111-148, 2003.

81. Algorithms for GPS Operation Indoors and Downtown
    N. Agarwal, J. Basch, P. Beckmann, P. Bharti, S. Bloebaum, S. Casadei, A. Chou, P. Enge, W. Fong, N. Hathi, W. Mann, A. Sahai, J. Stone, J. Tsitsiklis, and B. Van Roy
    GPS Solutions, Vol. 6, No. 3, pp. 149-160, December 2002.

82. On the Convergence of Optimistic Policy Iteration [correction]
    J. N. Tsitsiklis
    Journal of Machine Learning Research, Vol. 3, July 2002, pp. 59-72.

83. On Average Versus Discounted Reward Temporal-Difference Learning
    J. N. Tsitsiklis and B. Van Roy
    Machine Learning, Vol. 49, No. 2, pp. 179-191, November 2002.

84. Performance of Multiclass Markovian Queueing Networks via Piecewise Linear Lyapunov Functions  [correction]
    D. Bertsimas, D. Gamarnik, and J. N. Tsitsiklis
    The Annals of Applied Probability, Vol. 11, No. 4, pp. 1384-1428, 2001.

85. Regression Methods for Pricing Complex American-Style Options,
    J. N. Tsitsiklis and B. Van Roy
    IEEE Transactions on Neural Networks, Vol. 12, No. 4, July 2001, pp. 694-703.

86. The stability of saturated linear systems is undecidable
    V. D. Blondel, O. Bournez, P. Koiran, and J. N. Tsitsiklis
    Journal of Computer Systems Science, Vol. 62, pp. 442-462, 2001.

87. Deciding stability and mortality of piecewise affine systems
    V. D. Blondel, O. Bournez, P. Koiran, C. H. Papadimitriou, and J. N. Tsitsiklis
    Theoretical Computer Science, Vol. 255, No. 1-2, pp. 687-696, 2001.

88. Simulation-Based Optimization of Markov Reward Processes
    P. Marbach and J. N. Tsitsiklis
    IEEE Transactions on Automatic Control, Vol. 46, No. 2, pp. 191-209, February 2001.

89. Approximating the spectral radius of sets of matrices in the max-algebra is NP-hard
    V. D. Blondel, S. Gaubert, and J. N. Tsitsiklis
    IEEE Transactions on Automatic Control, Vol. 45, No. 9, pp. 1762-1765, September 2000.

90. The boundedness of all products of a pair of matrices is undecidable
    V. D. Blondel and J. N. Tsitsiklis
    Systems and Control Letters, Vol. 41, No. 2, pp. 135-140, 2000.

91. A Survey of Computational Complexity Results in Systems and Control
    V. D. Blondel and J. N. Tsitsiklis
    Automatica, Vol. 36, No. 9, pp. 1249-1274, September 2000.

92. Gradient Convergence in Gradient Methods with Errors
    D. P. Bertsekas and J. N. Tsitsiklis
    SIAM Journal in Optimization, Vol. 10, No. 3, 2000, pp. 627-642.

93. Congestion-Dependent Pricing of Network Services
    I. C. Paschalidis and J. N. Tsitsiklis
    IEEE/ACM Transactions on Networking, Vol. 8, No. 2, April 2000, pp. 171-184.

94. Call Admission Control and Routing in Integrated Service Networks Using Neuro-Dynamic Programming
    P. Marbach, O. Mihatsch, and J. N. Tsitsiklis
    IEEE Journal on Selected Areas in Communications, Vol. 18, No. 2, February 2000, pp. 197-208.

95. Large Deviations Analysis of the Generalized Processor Sharing Policy
    D. Bertsimas, I. C. Paschalidis, and J. N. Tsitsiklis
    Queueing Systems, Vol. 32, 1999, pp. 319-349.

96. Average Cost Temporal-Difference Learning
    J. N. Tsitsiklis, and B. Van Roy
    Automatica, Vol. 35, No. 11, November 1999, pp. 1799-1808.

97. Optimal Stopping of Markov Processes: Hilbert Space Theory, Approximation Algorithms, and an Application to Pricing Financial Derivatives
    J. N. Tsitsiklis and B. Van Roy
    IEEE Transactions on Automatic Control, Vol. 44, No. 10, October 1999, pp. 1840-1851.

98. Estimation of Time-Varying Parameters in Statistical Models; an Optimization Approach
    D. Bertsimas, D. Gamarnik, and J. N. Tsitsiklis
    Machine Learning,, Vol. 35, No. 3, 1999, pp. 225-245.

99. The Complexity of Optimal Queueing Network Control
    C. H. Papadimitriou and J. N. Tsitsiklis
    Mathematics of Operations Research, Vol. 24, No. 2, May 1999, pp. 293-305.

100. Complexity of Stability and Controllability of Elementary Hybrid Systems
     V. D. Blondel, and J. N. Tsitsiklis
     Automatica, Vol. 35, No. 3, March 1999.

101. On the Large Deviations Behavior of Acyclic Networks of G/G/1 Queues
     D. Bertsimas, I. C. Paschalidis, and J. N. Tsitsiklis
     The Annals of Applied Probability , Vol. 8, No. 4, November 1998, pp. 1027-1069.

102. Asymptotic Buffer Overflow Probabilities in Multiclass Multiplexers: An Optimal Control Approach
     D. Bertsimas, I. C. Paschalidis, and J. N. Tsitsiklis
     IEEE Transactions on Automatic Control. Vol. 43, No. 3, March 1988, pp. 315-335.

103. Implementation of Efficient Algorithms for Globally Optimal Trajectories
     L. C. Polymenakos, D. P. Bertsekas, and J. N. Tsitsiklis
     IEEE Transactions on Automatic Control, Vol. 43, No. 2, February 1998, pp. 278-283.

104. NP-hardness of some linear control design problems
     V. Blondel and J. N. Tsitsiklis
     SIAM J. on Control and Optimization , Vol. 35, No. 6, November 1997, pp. 2118-2127.

105. Rollout Algorithms for Combinatorial Optimization
     D. P. Bertsekas, J. N. Tsitsiklis, and C. Wu
     Journal of Heuristics, Vol. 3, 1997, pp. 245-262.

106. When is a Pair of Matrices Mortal?
     V. D. Blondel and J. N. Tsitsiklis
     Information Processing Letters , Vol. 63, No. 5, 1997, pp. 283-286.

107. The Lyapunov exponent and joint spectral radius of pairs of matrices are hard - when not impossible - to compute and to approximate
     J. N. Tsitsiklis and V. D. Blondel
     Mathematics of Control, Signals and Systems, Vol. 10, No. 1, 1997, pp. 31-40.   [correction in Vol. 10, No. 4, p. 381]

108. An Analysis of Temporal-Difference Learning with Function Approximation
     J. N. Tsitsiklis and B. Van Roy
     IEEE Transactions on Automatic Control, Vol. 42, No. 5, May 1997, pp. 674-690.

109. Stability Conditions for Multiclass Fluid Queueing Networks
     D. Bertsimas, D. Gamarnik, J. N. Tsitsiklis
     IEEE Transactions on Automatic Control, Vol. 41, No. 11, November 1996, pp. 1618-1631.

110. Stochastic Shortest Path Problems with Recourse
     G. H. Polychronopoulos and J. N. Tsitsiklis
     Networks, Vol. 27, No. 2, 1996, pp. 133-143.

111. Feature-Based Methods for Large Scale Dynamic Programming
     J. N. Tsitsiklis and B. Van Roy
     Machine Learning, Vol. 22, 1996, pp. 59-94.

112. Branching Bandits and Klimov's Problem: Achievable Region and Side Constraints
     D. Bertsimas, I. Paschalidis and J. N. Tsitsiklis
     IEEE Transactions on Automatic Control, Vol. 40, No. 12, December 1995, pp. 2063-2075.

113. Efficient Algorithms for Globally Optimal Trajectories
     J. N. Tsitsiklis
     IEEE Transactions on Automatic Control, Vol. 40, No. 9, September 1995, pp. 1528-1538.

114. On the Average Communication Complexity of Asynchronous Distributed Algorithms
     J. N. Tsitsiklis and G. D. Stamoulis
     Journal of the ACM, Vol. 42, No. 2, March 1995, pp. 382-400.

115. Statistical Multiplexing of Multiple Time-Scale Markov Streams
     D. N. C. Tse, R. G. Gallager, and J. N. Tsitsiklis
     IEEE Journal on Selected Areas in Communications, Vol. 13, No. 6, August 1995, pp. 1028-1038.

116. Worst-Case Identification of Nonlinear Fading Memory Systems
     M. A. Dahleh, E. D. Sontag, D. N. C. Tse, and J. N. Tsitsiklis
     Automatica, Vol. 31, No. 3, March 1995, pp. 503-508.

117. The Efficiency of Greedy Routing in Hypercubes and Butterflies
     G. D. Stamoulis and J. N. Tsitsiklis
     IEEE Transactions on Communications, Vol. 42, No. 11, November 1994, pp. 3051-3061.

118. Data Fusion with Minimal Communication
     Z.-Q. Luo and J. N. Tsitsiklis
     IEEE Transactions on Information Theory, Vol. 40, No. 5, September 1994, pp. 1551-1563.

119. Asynchronous Stochastic Approximation and Q-learning  [correction]
     J. N. Tsitsiklis
     Machine Learning, 16, 1994, pp. 185-202.

120. Local versus Non-Local Computation of Length of Digitized Curves
     S. R. Kulkarni, S. K. Mitter, T. J. Richardson, and J. N. Tsitsiklis
     IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 16, No. 7, July 1994.

121. Some Properties of Optimal Thresholds in Decentralized Detection
     W. W. Irving and J. N. Tsitsiklis
     IEEE Transactions on Automatic Control, Vol. 39, No. 4, April 1994, pp. 835-838.

122. Optimization of Multiclass Queueing Networks: Polyhedral and Nonlinear Characterizations of Achievable Performance
     D. Bertsimas, I. C. Paschalidis, and J. N. Tsitsiklis
     The Annals of Applied Probability, Vol. 4, No. 1, 1994, pp. 43-75.

123. A Short Proof of the Gittins Index Theorem
     J. N. Tsitsiklis
     The Annals of Applied Probability, Vol. 4, No. 1, 1994, pp. 194-199.

124. On the Communication Complexity of Distributed Algebraic Computation
     Z.-Q. Luo and J. N. Tsitsiklis
     Journal of the ACM, Vol. 40, No. 5, pp. 1019-1047, November 1993.

125. PAC Learning with Generalized Samples and an Application to Stochastic Geometry
     S. R. Kulkarni, S. K. Mitter, J. N. Tsitsiklis, and O. Zeitouni
     IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 15, No. 9, September 1993.

126. Simulated Annealing
     D. Bertsimas and J. N. Tsitsiklis
     Statistical Science, Vol. 8, No. 1, 1993, pp. 10-15.

127. Efficient Routing Schemes for Multiple Broadcasts in Hypercubes
     G. D. Stamoulis and J. N. Tsitsiklis
     IEEE Transactions on Parallel and Distributed Systems, Vol. 4, No. 7, July 1993, pp. 725-739.

128. Optimal Asymptotic Identification under Bounded Disturbances
     D. N. C. Tse, M. A. Dahleh, J. N. Tsitsiklis
     IEEE Transactions on Automatic Control, Vol. AC-38, No. 8, 1993, pp. 1176-1190.

129. An Efficient Algorithm for Multiple Simultaneous Broadcasts in the Hypercube
     G. D. Stamoulis and J. N. Tsitsiklis
     Information Processing Letters, Vol. 46, 1993, pp. 219-224.

130. Extremal Properties of Likelihood-Ratio Quantizers
     J. N. Tsitsiklis
     IEEE Transactions on Communications, Vol. 41, No. 4, 1993, pp. 550-558.

131. Active Learning Using Arbitrary Binary Valued Queries
     S. R. Kulkarni, S. K. Mitter and J. N. Tsitsiklis
     Machine Learning, Vol. 11, 1993, pp. 23-35.

132. The Sample Complexity of Worst-Case Identification of F.I.R. Linear Systems
     M. A. Dahleh, T. Theodosopoulos, and J. N. Tsitsiklis
     Systems and Control Letters, Vol. 20, 1993, pp. 157-166.

133. Dynamic Shortest Paths in Acyclic Networks with Markovian Arc Costs
     H. N. Psaraftis and J. N. Tsitsiklis
     Operations Research, Vol. 41, 1, 1993, pp. 91-101.

134. Special Cases of Traveling Salesman and Repairman Problems with Time Windows
     J. N. Tsitsiklis
     Networks., Vol. 22,No. 3, 1992, pp. 263-282.

135. On the Predictability of Coupled Automata: an Allegory about Chaos
     S. Buss, C. H. Papadimitriou, and J. N. Tsitsiklis
     Complex Systems, Vol. 5, No. 5, 1991, pp. 525-539.

136. On the Communication Complexity of Solving a Polynomial Equation
     Z.-Q. Luo and J. N. Tsitsiklis
     SIAM J. on Computing, Vol. 20, No. 5, October 1991, pp. 936-950.

137. An Analysis of Stochastic Shortest Path Problems
     D. P. Bertsekas and J. N. Tsitsiklis
     Mathematics of Operations Research, Vol. 16, No. 3, August 1991, pp. 580-595.

138. An Optimal One-Way Multigrid Algorithm for Discrete-Time Stochastic Control
     C.-S. Chow and J. N. Tsitsiklis
     IEEE Transactions on Automatic Control, Vol. AC-36, No. 8, 1991, pp. 898-914.

139. On a Lower Bound for the Redundancy of Reliable Networks with Noisy Gates
     N. Pippenger, G. D. Stamoulis, and J. N. Tsitsiklis
     IEEE Transactions on Information Theory, Vol. IT-37, May 1991, pp. 639-643.

140. Optimal Communication Algorithms for Hypercubes
     D. P. Bertsekas, C. Ozveren, G. D. Stamoulis, P. Tseng, and J. N. Tsitsiklis
     Journal of Parallel and Distributed Computing, Vol. 11, 1991, pp. 263-275.

141. Some Aspects of Parallel and Distributed Iterative Algorithms - A Survey
     D. P. Bertsekas and J. N. Tsitsiklis
     Automatica, Vol. 27, No. 1, 1991, pp. 3-21.

142. On the Settling Time of the Congested GI/G/1 Queue
     G. D. Stamoulis and J. N. Tsitsiklis
     Advances in Applied Probability, Vol. 22, 1990, pp. 929-956.

143. Partially Asynchronous, Parallel Algorithms for Network Flow and other Problems
     P. Tseng, D. P. Bertsekas, and J. N. Tsitsiklis
     SIAM Journal on Control and Optimization, Vol. 28, No. 3, May 1990, pp. 678-710.

144. Explicit Solutions for some Simple Decentralized Detection Problems
     G. Polychronopoulos and J. N. Tsitsiklis
     IEEE Transactions on Aerospace and Electronic Systems, Vol. 26, 1990, pp. 282-291.

145. The Complexity of Dynamic Programming  [correction]
     C.-S. Chow and J. N. Tsitsiklis
     Journal of Complexity, Vol. 5, No. 4, 1989, pp. 466-488.

146. A Comparison of Jacobi and Gauss-Seidel Parallel Iterations
     J. N. Tsitsiklis
     Applied Mathematics Letters, Vol. 2, No. 2, 1989, pp. 167-170.

147. On the Use of Random Numbers in Asynchronous Simulation via Rollback
     J. N. Tsitsiklis
     Information Processing Letters, Vol. 31, 1989, pp. 139-144.

148. On the Control of Discrete Event Dynamical Systems
     J. N. Tsitsiklis
     Mathematics of Control, Signals and Systems, Vol. 2, No. 2, 1989, pp. 95-107.

149. Markov Chains with Rare Transitions and Simulated Annealing
     J. N. Tsitsiklis
     Mathematics of Operations Research, Vol. 14, No. 1, 1989, pp. 70-90.

150. A Note on Strategy Elimination in Bimatrix Games
     D. E. Knuth, C. H. Papadimitriou, J. N. Tsitsiklis
     Operations Research Letters, Vol. 7, No. 3, 1988, pp. 103-107.

151. Decentralized Detection by a Large Number of Sensors [with correction included]
     J. N. Tsitsiklis
     Mathematics of Control, Signals and Systems, Vol. 1, No. 2, 1988, pp. 167-182.

152. On the Stability of Asynchronous Iterative Processes
     J. N. Tsitsiklis
     Mathematical Systems Theory, Vol. 20, No. 2-3, 1987, pp. 137-153.

153. Communication Complexity of Convex Optimization
     J. N. Tsitsiklis and Z.-Q. Luo
     Journal of Complexity, Vol. 3, No. 3, 1987, pp. 231-243. [1986 IEEE CDC version]
     

154. Analysis of a Multiaccess Control Scheme
     J. N. Tsitsiklis
     IEEE Transactions on Automatic Control, Vol. 32, No. 11, 1987, pp. 1017-1020.

155. The Complexity of Markov Decision Processes [erratum]
     C. H. Papadimitriou and J. N. Tsitsiklis
     Mathematics of Operations Research, Vol. 12, No. 3, 1987, pp. 441-450.

156. Stochastic Scheduling with In-Tree Precedence Constraints
     C. H. Papadimitriou and J. N. Tsitsiklis
     SIAM Journal on Computing, Vol. 16, No. 1, 1987, pp. 1-6.

157. Distributed Asynchronous Deterministic and Stochastic Gradient Optimization Algorithms
     J. N. Tsitsiklis, D. P. Bertsekas and M. Athans
     IEEE Transactions on Automatic Control, Vol. 31, No. 9, 1986, pp. 803-812.

158. The Performance of a Precedence-Based Queueing Discipline
     J. N. Tsitsiklis, C. H. Papadimitriou and P. Humblet
     Journal of the ACM, Vol. 33, No. 3, 1986, pp. 593-602.

159. Intractable Problems in Control Theory
     C. H. Papadimitriou and J. N. Tsitsiklis
     SIAM Journal on Control and Optimization, Vol. 24, No. 4, 1986, pp. 639-654.

160. A Lemma on the Multi-Armed Bandit Problem
     J. N. Tsitsiklis
     IEEE Transactions on Automatic Control, Vol. 31, No. 6, 1986, pp. 576-577.

161. Distributed Asynchronous Optimal Routing in Data Networks
     J. N. Tsitsiklis and D. P. Bertsekas
     IEEE Transactions on Automatic Control, Vol. 31, No. 4, 1986, pp. 325-332.

162. A Fast Algorithm for the Linear Estimation of Two-Dimensional Isotropic Random Fields
     B. C. Levy and J. N. Tsitsiklis
     IEEE Transactions on Information Theory, Vol. 31, No. 5, 1985, pp. 635-644.

163. On the Complexity of Decentralized Decision Making and Detection Problems
     J. N. Tsitsiklis and M. Athans
     IEEE Transactions on Automatic Control, Vol. 30, No.5, 1985, pp. 440-446.

164. Periodic Review Inventory Systems with Continuous Demand and Discrete Order Sizes
     J. N. Tsitsiklis
     Management Science, Vol. 30, No. 10, 1984, pp. 1250-1254.

165. A Simple Criterion for Structurally Fixed Modes
     C. H. Papadimitriou and J. N. Tsitsiklis
     Systems and Control Letters, Vol. 4, 1984, pp. 333-337.

166. Convexity and Characterization of Optimal Policies in a Dynamic Routing Problem
     J. N. Tsitsiklis
     Journal of Optimization Theory and Applications, Vol. 44, No. 1, 1984, pp. 105-136.

167. Guaranteed Robustness Properties of Multivariable Nonlinear Stochastic Optimal Regulators
     J. N. Tsitsiklis and M. Athans
     IEEE Transactions on Automatic Control, Vol. 29, No. 8, 1984, pp. 690-696.

168. Convergence and Asymptotic Agreement in Distributed Decision Problems
     J. N. Tsitsiklis and M. Athans
     IEEE Transactions on Automatic Control, Vol. 29, No. 1, 1984, pp. 42-50.

169. On the Complexity of Designing Distributed Protocols
     C. H. Papadimitriou and J. N. Tsitsiklis
     Information and Control, Vol. 53, No. 3, 1982, pp. 211-218.

170. Conditions for Finiteness of a Constructive Algorithm for Determining Stability
     J. N. Tsitsiklis
     IEEE Transactions on Circuits and Systems, Vol. 29, No. 6, 1982, pp. 400-402.

Theses

1. Linear Optimization Problems with Dynamical Structure
   B.Sc. Thesis, Department of EECS, MIT, January 1980.

2. Optimal Dynamic Routing in an Unreliable Manufacturing System
   M.Sc. Thesis, Department of EECS, MIT, February 1981; technical report LIDS-TH-1069, LIDS, MIT.

3. Problems in Decentralized Decision Making and Computation
   Ph.D. Thesis, Department of EECS, MIT, November 1984; technical report LIDS-TH-1424, LIDS, MIT.

Selected conference and other publications

1. Nonexpansive Piecewise Constant Hybrid Systems are Conservative
   A. Sharifnassab, J. N. Tsitsiklis, and S. J. Golestani
   unpublished technical report, May 2019.

2. The Value of Temporal Data for Learning of Influence Networks: a Characterization via Kullback-Leibler Divergence
   M. A. Dahleh, J. N Tsitsiklis, and S. I. Zoumpoulis
   Proceedings of the 54th IEEE Conference on Decision and Control, Osaka, Japan, December 2015.

3. A lower bound on the performance of dynamic curing policies for epidemics on graphs
   K. Drakopoulos, A. Ozdaglar, and J. N. Tsitsiklis
   Proceedings of the 54th IEEE Conference on Decision and Control, Osaka, Japan, December 2015.

4. Fundamental limitations for anonymous decentralized systems with broadcast communications
   J. M. Hendrickx and J. N. Tsitsiklis
   Proceedings of the 53rd Annual Allerton Conference on Communication, Control, and Computing, October 2015.

5. The Value of Feedback for Decentralized Detection in Large Sensor Networks
   W. P. Tay and J. N. Tsitsiklis
   Proceedings of the IEEE International Symposium on Wireless Pervasive Computing (ISWPC 2011), Hong Kong, China, February 2011.

6. Qualitative Properties of alpha-Weighted Scheduling Policies
   D. Shah, J. N. Tsitsiklis, and Y. Zhong
   Proceedings of the ACM Sigmetrics 2010, New York, NY, June 2010.

7. Weighted Gossip: Distributed Averaging Using Non-Doubly Stochastic Matrices
   F. Benezit, V. Blondel, P. Thiran, J. Tsitsiklis, and M. Vetterli
   2010 IEEE International Symposium on Information Theory, Austin, Texas, June 2010.

8. Distributed Subgradient Methods and Quantization Effects
   A. Nedic, A. Olshevsky, A. Ozdaglar, and J. N. Tsitsiklis
   Proceedings of the 47th IEEE Conference on Decision and Control, Cancun, Mexico, December 2008.

9. Convergence in Multiagent Coordination, Consensus, and Flocking [corrected version]
   V. D. Blondel, J. M. Hendrickx, A. Olshevsky, and J. N. Tsitsiklis,
   Proceedings of the Joint 44th IEEE Conference on Decision and Control and European Control Conference (CDC-ECC'05), Seville, Spain, December 2005.

10. Routing and Peering in a Competitive Internet
    R. Johari and J. N. Tsitsiklis
    Proceedings of the 2004 IEEE Conference on Decision and Control, Bahamas, December 2004.
    Extended version in technical report LIDS-P-2570, January 2003.

11. Dynamic Leadtime Management in Supply Chains
    A. Muharremoglu and J. N. Tsitsiklis
    Unpublished manuscript, June 2003.

12. Three Problems on the Decidability and Complexity of Stability
    V. D. Blondel and J. N. Tsitsiklis
    in Open Problems in Mathematical Systems and Control Theory, V.D. Blondel, E.D. Sontag, M. Vidyasagar, J.C. Willems (editors), Springer, 1999, pp. 46-51

13. Overview of complexity and decidability results for three classes of elementary nonlinear systems
    V. D. Blondel and J. N. Tsitsiklis
    in Learning, Control and Hybrid Systems (LNCIS, volume 241), Y. Yamamoto and S. Hara (Eds), Springer, 1999, pp. 46-58.

14. Geometric Bounds for Stationary Distributions of Infinite Markov Chains Via Lyapunov Functions
    D. Bertsimas, D. Gamarnik, and J. N. Tsitsiklis
    Technical report LIDS-P-2426, September 1998.

15. A Neuro-Dynamic Programming Approach to Call Admission Control in Integrated Service Networks: The Single Link Case
    P. Marbach and J. N. Tsitsiklis
    Proceedings of the 2003 IEEE Conference on Decision and Control, Maui, Hawaii, December 2003.
    Extended version in technical report LIDS-P-2402, November 1997.
    

16. A Neuro-Dynamic Programming Approach to Retailer Inventory Management  [extended version]
    B. Van Roy, D. P. Bertsekas, Y. Lee, and J. N. Tsitsiklis
    Proceedings of the 36th IEEE Conference on Decision and Control, San Diego, California, December 1997, pp. 4052-4057.
    

17. Stable Linear Approximations to Dynamic Programming for Stochastic Control Problems with Local Transitions
    B. Van Roy and J. N. Tsitsiklis
    Advances in Neural Information Processing Systems (NIPS) 8, MIT Press, 1996, pp. 1045-1051.

18. The Problem of Fringe Acquisition in High-Precision Space-Based Interferometers
    C. E. Padilla, V. I. Karlov, J. Li, H. M. Chun, J. N. Tsitsiklis, and R. D. Reasenberg
    SPIE Conference # 2477 on Spaceborne Interferometry II, Orlando, Florida, April 1995, p. 47.

19. A Study of Fringe Tracking for High-Precision Space-Based Interferometers
    C. E. Padilla, V. I. Karlov, J. Li, H. M. Chun, J. N. Tsitsiklis, and R. D. Reasenberg
    SPIE Conference # 2477 on Spaceborne Interferometry II, Orlando, Florida, April 1995, p. 63.

20. Optimal Distributed Policies for Choosing Among Multiple Servers
    G. D. Stamoulis and J. N. Tsitsiklis
    Proceedings of the 30th IEEE Conference on Decision and Control, Brighton, England, December 1991, pp. 815-820.

21. Convergence Rate and Termination of Asynchronous Iterative Algorithms
    D. P. Bertsekas and J. N. Tsitsiklis
    Proceedings of the 1989 International Conference on Supercomputing, Irakleion, Greece, June 1989, pp. 461-470.

22. Lower Bounds on the Time to Compute a Simple Boolean Function on a Parallel Random Access Machine
    Z.-Q. Luo and J. N. Tsitsiklis
    Technical Report LIDS-P-1616, October 1986.

23. Integral Equations and Resolvents of Toeplitz plus Hankel Kernels
    J. N. Tsitsiklis and B. C. Levy
    Technical Report LIDS-P-1170, December 1981.

24. Linear Estimation of Stationary Stochastic Processes, Vibrating Strings, and Inverse Scattering
    B. C. Levy and J. N. Tsitsiklis
    Technical Report LIDS-P-1155, November 1982.