research-article

Runtime feedback in a meta-tracing JIT for efficient dynamic languages

Authors:

Carl Friedrich Bolz,

Maciej Fijałkowski,

Michael Leuschel,

Samuele Pedroni,

Armin RigoAuthors Info & Claims

ICOOOLPS '11: Proceedings of the 6th Workshop on Implementation, Compilation, Optimization of Object-Oriented Languages, Programs and Systems

Article No.: 9, Pages 1 - 8

https://doi.org/10.1145/2069172.2069181

Published: 26 July 2011 Publication History

Abstract

Meta-tracing JIT compilers can be applied to a variety of different languages without explicitly encoding language semantics into the compiler. So far, they lacked a way to give the language implementor control over runtime feedback. This restricted their performance. In this paper we describe the mechanisms in PyPy's meta-tracing JIT that can be used to control runtime feedback in language-specific ways. These mechanisms are flexible enough to express classical VM techniques such as maps and runtime type feedback.

References

[1]

D. Ancona, M. Ancona, A. Cuni, and N. D. Matsakis. RPython: a step towards reconciling dynamically and statically typed OO languages. In DLS, Montreal, Quebec, Canada, 2007. ACM.

Digital Library

[2]

V. Bala, E. Duesterwald, and S. Banerjia. Dynamo: a transparent dynamic optimization system. ACM SIGPLAN Notices, 35(5):1--12, 2000.

Digital Library

[3]

M. Bebenita, F. Brandner, M. Fahndrich, F. Logozzo, W. Schulte, N. Tillmann, and H. Venter. SPUR: a trace-based JIT compiler for CIL. In OOPSLA, Reno/Tahoe, Nevada, USA, 2010. ACM.

Digital Library

[4]

C. F. Bolz, A. Cuni, M. Fijałkowski, M. Leuschel, S. Pedroni, and A. Rigo. Allocation removal by partial evaluation in a tracing JIT. In PEPM, PEPM '11, 2011.

Digital Library

[5]

C. F. Bolz, A. Cuni, M. Fijałkowski, and A. Rigo. Tracing the metalevel: PyPy's tracing JIT compiler. In ICOOOLPS, pages 18--25, Genova, Italy, 2009. ACM.

Digital Library

[6]

C. F. Bolz, M. Leuschel, and D. Schneider. Towards a jitting VM for prolog execution. In PPDP, Hagenberg, Austria, 2010. ACM.

Digital Library

[7]

C. Chambers, D. Ungar, and E. Lee. An efficient implementation of SELF a dynamically-typed object-oriented language based on prototypes. In OOPSLA, volume 24, 1989.

Digital Library

[8]

L. P. Deutsch and A. M. Schiffman. Efficient implementation of the smalltalk-80 system. In POPL, Salt Lake City, Utah, 1984. ACM.

Digital Library

[9]

Y. Futamura. Partial evaluation of computation process - an approach to a Compiler-Compiler. Higher-Order and Symbolic Computation, 12(4):381--391, 1999.

Digital Library

[10]

A. Gal, B. Eich, M. Shaver, D. Anderson, D. Mandelin, M. R. Haghighat, B. Kaplan, G. Hoare, B. Zbarsky, J. Orendorff, J. Ruderman, E. W. Smith, R. Reitmaier, M. Bebenita, M. Chang, and M. Franz. Trace-based just-in-time type specialization for dynamic languages. In PLDI, PLDI '09, New York, New York, 2009. ACM. ACM ID: 1542528.

Digital Library

[11]

A. Gal and M. Franz. Incremental dynamic code generation with trace trees. Technical Report ICS-TR-06-16, Donald Bren School of Information and Computer Science, University of California, Irvine, Nov. 2006.

[12]

A. Gal, C. W. Probst, and M. Franz. HotpathVM: an effective JIT compiler for resource-constrained devices. In VEE, Ottawa, Ontario, Canada, 2006. ACM.

Digital Library

[13]

A. Georges, D. Buytaert, and L. Eeckhout. Statistically rigorous java performance evaluation. SIGPLAN Notices, 42(10):57--76, 2007.

Digital Library

[14]

B. Grant, M. Mock, M. Philipose, C. Chambers, and S. J. Eggers. DyC: an expressive annotation-directed dynamic compiler for c. Theoretical Computer Science, 248:147--199, Oct. 2000. ACM ID: 357493.

Digital Library

[15]

U. Hölzle and D. Ungar. Optimizing dynamically-dispatched calls with run-time type feedback. In PLDI, pages 326--336, Orlando, Florida, United States, 1994. ACM.

Digital Library

[16]

N. D. Jones, C. K. Gomard, and P. Sestoft. Partial evaluation and automatic program generation. Prentice-Hall, 1993.

Digital Library

[17]

A. Rigo. Representation-based just-in-time specialization and the psyco prototype for python. In PEPM, Verona, Italy, 2004. ACM.

Digital Library

[18]

A. Rigo and S. Pedroni. PyPy's approach to virtual machine construction. In DLS, Portland, Oregon, USA, 2006. ACM.

Digital Library

[19]

J. R. Rose. Bytecodes meet combinators: invokedynamic on the JVM. Proceedings of the Third Workshop on Virtual Machines and Intermediate Languages, 2009.

Digital Library

[20]

G. T. Sullivan, D. L. Bruening, I. Baron, T. Garnett, and S. Amarasinghe. Dynamic native optimization of interpreters. In Workshop on Interpreters, virtual machines and emulators, San Diego, California, 2003. ACM.

Digital Library

[21]

M. Wolczko, O. Agesen, and D. Ungar. Towards a universal implementation substrate for Object-Oriented languages. In OOPSLA workshop on Simplicity, Performance, and Portability in Virtual Machine Design, 1999.

Digital Library

[22]

A. Yermolovich, C. Wimmer, and M. Franz. Optimization of dynamic languages using hierarchical layering of virtual machines. In DLS, pages 79--88, Orlando, Florida, USA, 2009. ACM.

Digital Library

Cited By

Campora JKhan MChen S(2024)Type-Based Gradual Typing Performance OptimizationProceedings of the ACM on Programming Languages10.1145/36329318:POPL(2667-2699)Online publication date: 5-Jan-2024
https://dl.acm.org/doi/10.1145/3632931
Chevalier-Boisvert MKokubun TGibbs NWu SPatterson AIssroff JBruno RMoss E(2023)Evaluating YJIT’s Performance in a Production Context: A Pragmatic ApproachProceedings of the 20th ACM SIGPLAN International Conference on Managed Programming Languages and Runtimes10.1145/3617651.3622982(20-33)Online publication date: 19-Oct-2023
https://dl.acm.org/doi/10.1145/3617651.3622982
de Mooij JGaudet MIreland IHenderson NAmaral JBruno RMoss E(2023)CacheIR: The Benefits of a Structured Representation for Inline CachesProceedings of the 20th ACM SIGPLAN International Conference on Managed Programming Languages and Runtimes10.1145/3617651.3622979(34-46)Online publication date: 19-Oct-2023
https://dl.acm.org/doi/10.1145/3617651.3622979
Show More Cited By

Index Terms

Runtime feedback in a meta-tracing JIT for efficient dynamic languages
1. Software and its engineering
  1. Software notations and tools
    1. Compilers

Recommendations

Amalgamating different JIT compilations in a meta-tracing JIT compiler framework
DLS 2020: Proceedings of the 16th ACM SIGPLAN International Symposium on Dynamic Languages

Most virtual machines employ just-in-time (JIT) compilers to achieve high-performance. Trace-based compilation and method-based compilation are two major compilation strategies in JIT compilers. In general, the former excels in compiling programs with ...
Definitional Interpreters for Higher-Order Programming Languages

Higher-order programming languages (i.e., languages in which procedures or labels can occur as values) are usually defined by interpreters that are themselves written in a programming language based on the lambda calculus (i.e., an applicative language ...
Definitional interpreters for higher-order programming languages
ACM '72: Proceedings of the ACM annual conference - Volume 2

Higher-order programming languages (i.e., languages in which procedures or labels can occur as values) are usually defined by interpreters which are themselves written in a programming language based on the lambda calculus (i.e., an applicative language ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

ICOOOLPS '11: Proceedings of the 6th Workshop on Implementation, Compilation, Optimization of Object-Oriented Languages, Programs and Systems

July 2011

64 pages

ISBN:9781450308946

DOI:10.1145/2069172

Conference Chairs:
Ian Rogers
Google
,
Eric Jul
DIKU, The University of Copenhagen
,
Olivier Zendra
INRIA/LORIA

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Lancaster University: Lancaster University
AITO: Assoc Internationale por les Technologies Objects

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 July 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Bundesministerium für Bildung und Forschung

Conference

ECOOP '11

Sponsor:

Lancaster University
AITO

ECOOP '11: European Conference on Object-Oriented Programming

July 26, 2011

Lancaster, United Kingdom

Acceptance Rates

Overall Acceptance Rate 11 of 14 submissions, 79%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

31
Total Citations
View Citations
271
Total Downloads

Downloads (Last 12 months)17
Downloads (Last 6 weeks)1

Reflects downloads up to 04 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Campora JKhan MChen S(2024)Type-Based Gradual Typing Performance OptimizationProceedings of the ACM on Programming Languages10.1145/36329318:POPL(2667-2699)Online publication date: 5-Jan-2024
https://dl.acm.org/doi/10.1145/3632931
Chevalier-Boisvert MKokubun TGibbs NWu SPatterson AIssroff JBruno RMoss E(2023)Evaluating YJIT’s Performance in a Production Context: A Pragmatic ApproachProceedings of the 20th ACM SIGPLAN International Conference on Managed Programming Languages and Runtimes10.1145/3617651.3622982(20-33)Online publication date: 19-Oct-2023
https://dl.acm.org/doi/10.1145/3617651.3622982
de Mooij JGaudet MIreland IHenderson NAmaral JBruno RMoss E(2023)CacheIR: The Benefits of a Structured Representation for Inline CachesProceedings of the 20th ACM SIGPLAN International Conference on Managed Programming Languages and Runtimes10.1145/3617651.3622979(34-46)Online publication date: 19-Oct-2023
https://dl.acm.org/doi/10.1145/3617651.3622979
Chevalier-Boisvert MGibbs NBoussier JWu SPatterson ANewton KHawthorn JRichards GRigger M(2021)YJIT: a basic block versioning JIT compiler for CRubyProceedings of the 13th ACM SIGPLAN International Workshop on Virtual Machines and Intermediate Languages10.1145/3486606.3486781(25-32)Online publication date: 19-Oct-2021
https://dl.acm.org/doi/10.1145/3486606.3486781
Izawa YMasuhara H(2020)Amalgamating different JIT compilations in a meta-tracing JIT compiler frameworkProceedings of the 16th ACM SIGPLAN International Symposium on Dynamic Languages10.1145/3426422.3426977(1-15)Online publication date: 17-Nov-2020
https://dl.acm.org/doi/10.1145/3426422.3426977
Cheng LIlbeyi BBolz-Tereick CBatten CMars JTang LXue JWu P(2020)Type freezing: exploiting attribute type monomorphism in tracing JIT compilersProceedings of the 18th ACM/IEEE International Symposium on Code Generation and Optimization10.1145/3368826.3377907(16-29)Online publication date: 22-Feb-2020
https://dl.acm.org/doi/10.1145/3368826.3377907
Schütze LCastrillon JNierstrasz OGray JOliveira B(2019)Efficient late binding of dynamic function compositionsProceedings of the 12th ACM SIGPLAN International Conference on Software Language Engineering10.1145/3357766.3359543(141-151)Online publication date: 20-Oct-2019
https://dl.acm.org/doi/10.1145/3357766.3359543
Izawa Y(2019)BacCamlCompanion Proceedings of the 3rd International Conference on the Art, Science, and Engineering of Programming10.1145/3328433.3328466(1-3)Online publication date: 1-Apr-2019
https://dl.acm.org/doi/10.1145/3328433.3328466
Izawa YMasuhara HAotani T(2019)Extending a meta-tracing compiler to mix method and tracing compilationCompanion Proceedings of the 3rd International Conference on the Art, Science, and Engineering of Programming10.1145/3328433.3328439(1-3)Online publication date: 1-Apr-2019
https://dl.acm.org/doi/10.1145/3328433.3328439
Würthinger TWimmer CHumer CWöß AStadler LSeaton CDuboscq GSimon DGrimmer M(2017)Practical partial evaluation for high-performance dynamic language runtimesACM SIGPLAN Notices10.1145/3140587.306238152:6(662-676)Online publication date: 14-Jun-2017
https://dl.acm.org/doi/10.1145/3140587.3062381
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents