3 years ago

Solving stackelberg security markov games employing the bargaining nash approach: convergence analysis

This paper proposes a new approach for the Stackelberg security Markov games' solution, by computing a cooperative approach for the defenders employing the bargaining Nash solution, while the attackers play in a non-cooperative manner. The bargaining Nash solution forces the defenders to negotiate in order to improve their position. A fundamental element of such a game is the disagreement point (status quo), which plays a role of a deterrent. A bargaining solution is defined as a single-valued function that selects an outcome from among the feasible pay-offs for each bargaining problem, which in turn is the result of cooperation by the defenders involved in the game. The agreement reached in the game is the most desirable alternative within the set of feasible outcomes. The attackers, playing non-cooperatively, compute the Nash equilibrium point. We employ the Lagrange principle to represent the original game formulation as a nonlinear programming problem. To compute the equilibrium point of the Stackelberg security Markov game, we use an iterative proximal gradient approach. This way, the problem is transformed into a system of equations, which represent an optimization problem for which the necessary condition of a minimum is solved by the projection gradient method. An analysis of the convergence to the Stackelberg security equilibrium point is presented, as well as a random walk solution for planning the patrol schedule which incorporates additional information about the targets using the entropy. The usefulness of the method is successfully demonstrated by a numerical example.

Publisher URL: www.sciencedirect.com/science

DOI: S0167404818300221

You might also like
Discover & Discuss Important Research

Keeping up-to-date with research can feel impossible, with papers being published faster than you'll ever be able to read them. That's where Researcher comes in: we're simplifying discovery and making important discussions happen. With over 19,000 sources, including peer-reviewed journals, preprints, blogs, universities, podcasts and Live events across 10 research areas, you'll never miss what's important to you. It's like social media, but better. Oh, and we should mention - it's free.

  • Download from Google Play
  • Download from App Store
  • Download from AppInChina

Researcher displays publicly available abstracts and doesn’t host any full article content. If the content is open access, we will direct clicks from the abstracts to the publisher website and display the PDF copy on our platform. Clicks to view the full text will be directed to the publisher website, where only users with subscriptions or access through their institution are able to view the full article.