DOCSLIB.ORG

Stringi: Character String Processing Facilities

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Stringi: Character String Processing Facilities Package ‘stringi’ August 25, 2021 Version 1.7.4 Date 2021-08-12 Title Character String Processing Facilities Description A multitude of character string/text/natural language processing tools: pattern searching (e.g., with 'Java'-like regular expressions or the 'Unicode' collation algorithm), random string generation, case mapping, string transliteration, concatenation, sorting, padding, wrapping, Unicode normalisation, date-time formatting and parsing, and many more. They are fast, consistent, convenient, and - thanks to 'ICU' (International Components for Unicode) - portable across all locales and platforms. URL https://stringi.gagolewski.com/ http://site.icu-project.org/ https://www.unicode.org/ BugReports https://github.com/gagolews/stringi/issues SystemRequirements C++11, ICU4C (>= 55, optional) Type Package Depends R (>= 3.1) Imports tools, utils, stats Biarch TRUE License file LICENSE Author Marek Gagolewski [aut, cre, cph] (<https://orcid.org/0000-0003-0637-6028>), Bartek Tartanus [ctb], and others (stringi source code); IBM, Unicode, Inc. and others (ICU4C source code, Unicode Character Database) Maintainer Marek Gagolewski <[email protected]> RoxygenNote 7.1.1 Encoding UTF-8 NeedsCompilation yes License_is_FOSS yes Repository CRAN Date/Publication 2021-08-25 12:50:02 UTC 1 2 R topics documented: R topics documented: about_arguments . .4 about_encoding . .5 about_locale . .9 about_search . 10 about_search_boundaries . 12 about_search_charclass . 13 about_search_coll . 18 about_search_fixed . 19 about_search_regex . 20 about_stringi . 24 stri_compare . 26 stri_count . 29 stri_count_boundaries . 30 stri_datetime_add . 32 stri_datetime_create . 33 stri_datetime_fields . 35 stri_datetime_format . 36 stri_datetime_fstr . 40 stri_datetime_now . 41 stri_datetime_symbols . 42 stri_detect . 43 stri_dup . 46 stri_duplicated . 47 stri_encode . 48 stri_enc_detect . 50 stri_enc_detect2 . 52 stri_enc_fromutf32 . 54 stri_enc_info . 55 stri_enc_isascii . 56 stri_enc_isutf16be . 57 stri_enc_isutf8 . 58 stri_enc_list . 59 stri_enc_mark . 60 stri_enc_set . 61 stri_enc_toascii . 62 stri_enc_tonative . 63 stri_enc_toutf32 . 64 stri_enc_toutf8 . 65 stri_escape_unicode . 66 stri_extract_all . 67 stri_extract_all_boundaries . 70 stri_flatten . 72 stri_info . 73 stri_isempty . 74 stri_join . 75 stri_join_list . 76 R topics documented: 3 stri_length . 77 stri_list2matrix . 78 stri_locale_info . 80 stri_locale_list . 81 stri_locale_set . 82 stri_locate_all . 83 stri_locate_all_boundaries . 87 stri_match_all . 89 stri_na2empty . 91 stri_numbytes . 92 stri_opts_brkiter . 93 stri_opts_collator . 95 stri_opts_fixed . 97 stri_opts_regex . 99 stri_order . 101 stri_pad_both . 102 stri_rand_lipsum . 104 stri_rand_shuffle . 105 stri_rand_strings . 106 stri_rank . 107 stri_read_lines . 108 stri_read_raw . 109 stri_remove_empty . 110 stri_replace_all . 111 stri_replace_na . 115 stri_replace_rstr . 116 stri_reverse . 116 stri_sort . 117 stri_sort_key . 118 stri_split . 120 stri_split_boundaries . 122 stri_split_lines . 124 stri_sprintf . 126 stri_startswith . 128 stri_stats_general . 131 stri_stats_latex . 132 stri_sub . 133 stri_subset . ..
Load more

Recommended publications
  • PROC SORT (Then And) NOW Derek Morgan, PAREXEL International
    Paper 143-2019 PROC SORT (then and) NOW Derek Morgan, PAREXEL International ABSTRACT The SORT procedure has been an integral part of SAS® since its creation. The sort-in-place paradigm made the most of the limited resources at the time, and almost every SAS program had at least one PROC SORT in it. The biggest options at the time were to use something other than the IBM procedure SYNCSORT as the sorting algorithm, or whether you were sorting ASCII data versus EBCDIC data. These days, PROC SORT has fallen out of favor; after all, PROC SQL enables merging without using PROC SORT first, while the performance advantages of HASH sorting cannot be overstated. This leads to the question: Is the SORT procedure still relevant to any other than the SAS novice or the terminally stubborn who refuse to HASH? The answer is a surprisingly clear “yes". PROC SORT has been enhanced to accommodate twenty-first century needs, and this paper discusses those enhancements. INTRODUCTION The largest enhancement to the SORT procedure is the addition of collating sequence options. This is first and foremost recognition that SAS is an international software package, and SAS users no longer work exclusively with English-language data. This capability is part of National Language Support (NLS) and doesn’t require any additional modules. You may use standard collations, SAS-provided translation tables, custom translation tables, standard encodings, or rules to produce your sorted dataset. However, you may only use one collation method at a time. USING STANDARD COLLATIONS, TRANSLATION TABLES AND ENCODINGS A long time ago, SAS would allow you to sort data using ASCII rules on an EBCDIC system, and vice versa.
    [Show full text]
  • SLP-5 Setup for Uni-3/5/7 & WM-Nano Chinese BIG5 Characters
    SLP-5 Configuration for Uni-3, Uni-5, Uni-7 & WM-Nano Chinese BIG5 Characters The Uni-3, Uni-5, Uni-7 scales and WM-Nano wrapper can display and print PLU information in Chinese BIG5, also known as Traditional, characters but all menus, etc. remain in English. Chinese characters are entered in SLP-5 and sent to the scales. Chinese characters cannot be entered at the scales. Refer to the following procedure to configure the scales and wrapper and SLP-5. SCALE SETUP Update the firmware for the Uni-5, Uni-7 and WM-Nano to the following versions. Uni-5: C1830x Uni-7: C1828x (PK-260A CF CPU), C2072x (PK-260B SD CPU) WM-Nano: C1832x (PK-260A CF CPU), C2074x (PK-260B SD CPU) Uni-3: C1937U or later, C2271x The Language setting in the Uni-3 must be set to print and display Chinese characters. Note: Only the Uni-3L2 models display Chinese characters. KEY IN ITEM No. Enter 6000, press MODE 0.000 0.000 0.00 0.00 <B00 SETUP> Enter 495344, press PLU <B00 SETUP> <B00 SETUP> Enter 26, press Down Arrow <B00 SETUP> B26 COUNTRY Press ENTER B26 COUNTRY *LANGUAGE 1:ENGLISH Enter 15, press ENTER B26-01-02 LANGUAGE 1 *LANGUAGE 15:FORMOSAN After the long beep press MODE B26-01-02 LANGUAGE 15 REBOOT Shut off the scale for this setting change to 19004-0000 take effect. SLP-5 SETUP SLP-5 must be configured to use Chinese fonts. Refer to the instructions below. The following Chinese character sizes are available.
    [Show full text]
  • Chapter 2 Working with Text: Basics Copyright
    Writer Guide Chapter 2 Working with Text: Basics Copyright This document is Copyright © 2021 by the LibreOffice Documentation Team. Contributors are listed below. You may distribute it and/or modify it under the terms of either the GNU General Public License (https://www.gnu.org/licenses/gpl.html), version 3 or later, or the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), version 4.0 or later. All trademarks within this guide belong to their legitimate owners. Contributors To this edition Rafael Lima Jean Hollis Weber Kees Kriek To previous editions Jean Hollis Weber Bruce Byfield Gillian Pollack Ron Faile Jr. John A. Smith Hazel Russman John M. Długosz Shravani Bellapukonda Kees Kriek Feedback Please direct any comments or suggestions about this document to the Documentation Team’s mailing list: [email protected] Note Everything you send to a mailing list, including your email address and any other personal information that is written in the message, is publicly archived and cannot be deleted. Publication date and software version Published April 2021. Based on LibreOffice 7.1 Community. Other versions of LibreOffice may differ in appearance and functionality. Using LibreOffice on macOS Some keystrokes and menu items are different on macOS from those used in Windows and Linux. The table below gives some common substitutions for the instructions in this document. For a detailed list, see the application Help. Windows or Linux macOS equivalent Effect Tools > Options LibreOffice >
    [Show full text]
  • IPDS Technical Reference 1
    IPDS Technical Reference 1 TABLE OF CONTENTS Manuals for the IPDS card.................................................................................................................................4 Notice..................................................................................................................................................................5 Important.........................................................................................................................................................5 How to Read This Manual................................................................................................................................. 6 Symbols...........................................................................................................................................................6 About This Book..................................................................................................................................................7 Audience.........................................................................................................................................................7 Terminology.................................................................................................................................................... 7 About IPDS.......................................................................................................................................................... 8 Capabilities of IPDS............................................................................................................................................9
    [Show full text]
  • International Standard Iso/Iec 10646
    This is a preview - click here to buy the full publication INTERNATIONAL ISO/IEC STANDARD 10646 Sixth edition 2020-12 Information technology — Universal coded character set (UCS) Technologies de l'information — Jeu universel de caractères codés (JUC) Reference number ISO/IEC 10646:2020(E) © ISO/IEC 2020 This is a preview - click here to buy the full publication ISO/IEC 10646:2020 (E) CONTENTS 1 Scope ..................................................................................................................................................1 2 Normative references .........................................................................................................................1 3 Terms and definitions .........................................................................................................................2 4 Conformance ......................................................................................................................................8 4.1 General ....................................................................................................................................8 4.2 Conformance of information interchange .................................................................................8 4.3 Conformance of devices............................................................................................................8 5 Electronic data attachments ...............................................................................................................9 6 General structure
    [Show full text]
  • Computer Science II
    Computer Science II Dr. Chris Bourke Department of Computer Science & Engineering University of Nebraska|Lincoln Lincoln, NE 68588, USA http://chrisbourke.unl.edu [email protected] 2019/08/15 13:02:17 Version 0.2.0 This book is a draft covering Computer Science II topics as presented in CSCE 156 (Computer Science II) at the University of Nebraska|Lincoln. This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License i Contents 1 Introduction1 2 Object Oriented Programming3 2.1 Introduction.................................... 3 2.2 Objects....................................... 4 2.3 The Four Pillars.................................. 4 2.3.1 Abstraction................................. 4 2.3.2 Encapsulation................................ 4 2.3.3 Inheritance ................................. 4 2.3.4 Polymorphism................................ 4 2.4 SOLID Principles................................. 4 2.4.1 Inversion of Control............................. 4 3 Relational Databases5 3.1 Introduction.................................... 5 3.2 Tables ....................................... 9 3.2.1 Creating Tables...............................10 3.2.2 Primary Keys................................16 3.2.3 Foreign Keys & Relating Tables......................18 3.2.4 Many-To-Many Relations .........................22 3.2.5 Other Keys .................................24 3.3 Structured Query Language ...........................26 3.3.1 Creating Data................................28 3.3.2 Retrieving Data...............................30
    [Show full text]
  • Unicode and Code Page Support
    Natural for Mainframes Unicode and Code Page Support Version 4.2.6 for Mainframes October 2009 This document applies to Natural Version 4.2.6 for Mainframes and to all subsequent releases. Specifications contained herein are subject to change and these changes will be reported in subsequent release notes or new editions. Copyright © Software AG 1979-2009. All rights reserved. The name Software AG, webMethods and all Software AG product names are either trademarks or registered trademarks of Software AG and/or Software AG USA, Inc. Other company and product names mentioned herein may be trademarks of their respective owners. Table of Contents 1 Unicode and Code Page Support .................................................................................... 1 2 Introduction ..................................................................................................................... 3 About Code Pages and Unicode ................................................................................ 4 About Unicode and Code Page Support in Natural .................................................. 5 ICU on Mainframe Platforms ..................................................................................... 6 3 Unicode and Code Page Support in the Natural Programming Language .................... 7 Natural Data Format U for Unicode-Based Data ....................................................... 8 Statements .................................................................................................................. 9 Logical
    [Show full text]
  • Automatic Labeling of Voiced Consonants for Morphological Analysis of Modern Japanese Literature
    Automatic Labeling of Voiced Consonants for Morphological Analysis of Modern Japanese Literature Teruaki Oka† Mamoru Komachi† [email protected] [email protected] Toshinobu Ogiso‡ Yuji Matsumoto† [email protected] [email protected] Nara Institute of Science and Technology National† Institute for Japanese Language and Linguistics ‡ Abstract literary text,2 which achieves high performance on analysis for existing electronic text (e.g. Aozora- Since the present-day Japanese use of bunko, an online digital library of freely available voiced consonant mark had established books and work mainly from out-of-copyright ma- in the Meiji Era, modern Japanese lit- terials). erary text written in the Meiji Era of- However, the performance of morphological an- ten lacks compulsory voiced consonant alyzers using the dictionary deteriorates if the text marks. This deteriorates the performance is not normalized, because these dictionaries often of morphological analyzers using ordi- lack orthographic variations such as Okuri-gana,3 nary dictionary. In this paper, we pro- accompanying characters following Kanji stems pose an approach for automatic labeling of in Japanese written words. This is problematic voiced consonant marks for modern liter- because not all historical texts are manually cor- ary Japanese. We formulate the task into a rected with orthography, and it is time-consuming binary classification problem. Our point- to annotate by hand. It is one of the major issues wise prediction method uses as its feature in applying NLP tools to Japanese Linguistics be- set only surface information about the sur- cause ancient materials often contain a wide vari- rounding character strings.
    [Show full text]
  • Unicode Collators
    Title stata.com unicode collator — Language-specific Unicode collators Description Syntax Remarks and examples Also see Description unicode collator list lists the subset of locales that have language-specific collators for the Unicode string comparison functions: ustrcompare(), ustrcompareex(), ustrsortkey(), and ustrsortkeyex(). Syntax unicode collator list pattern pattern is one of all, *, *name*, *name, or name*. If you specify nothing, all, or *, then all results will be listed. *name* lists all results containing name; *name lists all results ending with name; and name* lists all results starting with name. Remarks and examples stata.com Remarks are presented under the following headings: Overview of collation The role of locales in collation Further controlling collation Overview of collation Collation is the process of comparing and sorting Unicode character strings as a human might logically order them. We call this ordering strings in a language-sensitive manner. To do this, Stata uses a Unicode tool known as the Unicode collation algorithm, or UCA. To perform language-sensitive string sorts, you must combine ustrsortkey() or ustr- sortkeyex() with sort. It is a complicated process and there are several issues about which you need to be aware. For details, see [U] 12.4.2.5 Sorting strings containing Unicode characters. To perform language-sensitive string comparisons, you can use ustrcompare() or ustrcompareex(). For details about the UCA, see http://www.unicode.org/reports/tr10/. The role of locales in collation During collation, Stata can use the default collator or it can perform language-sensitive string comparisons or sorts that require knowledge of a locale. A locale identifies a community with a certain set of preferences for how their language should be written; see [U] 12.4.2.4 Locales in Unicode.
    [Show full text]
  • Using Functions
    TIBCO WebFOCUS® Using Functions Release 8207 May 2021 DN4501670.0521 Copyright © 2021. TIBCO Software Inc. All Rights Reserved. Contents 1. How to Use This Manual ...................................................... 17 Available Languages .................................................................17 Operating Systems .................................................................. 17 2. Introducing Functions .........................................................19 Using Functions .....................................................................19 Types of Functions ...................................................................20 WebFOCUS-specific Functions.................................................... 22 Simplified Analytic Functions..................................................... 22 Simplified Character Functions....................................................23 Character Functions.............................................................25 Variable Length Character Functions...............................................28 Character Functions for DBCS Code Pages......................................... 29 Maintain-specific Character Functions..............................................30 Data Source and Decoding Functions..............................................31 Simplified Date and Date-Time Functions...........................................33 Date Functions................................................................. 33 Standard Date Functions..................................................
    [Show full text]
  • Database Globalization Support Guide
    Oracle® Database Database Globalization Support Guide 19c E96349-05 May 2021 Oracle Database Database Globalization Support Guide, 19c E96349-05 Copyright © 2007, 2021, Oracle and/or its affiliates. Primary Author: Rajesh Bhatiya Contributors: Dan Chiba, Winson Chu, Claire Ho, Gary Hua, Simon Law, Geoff Lee, Peter Linsley, Qianrong Ma, Keni Matsuda, Meghna Mehta, Valarie Moore, Cathy Shea, Shige Takeda, Linus Tanaka, Makoto Tozawa, Barry Trute, Ying Wu, Peter Wallack, Chao Wang, Huaqing Wang, Sergiusz Wolicki, Simon Wong, Michael Yau, Jianping Yang, Qin Yu, Tim Yu, Weiran Zhang, Yan Zhu This software and related documentation are provided under a license agreement containing restrictions on use and disclosure and are protected by intellectual property laws. Except as expressly permitted in your license agreement or allowed by law, you may not use, copy, reproduce, translate, broadcast, modify, license, transmit, distribute, exhibit, perform, publish, or display any part, in any form, or by any means. Reverse engineering, disassembly, or decompilation of this software, unless required by law for interoperability, is prohibited. The information contained herein is subject to change without notice and is not warranted to be error-free. If you find any errors, please report them to us in writing. If this is software or related documentation that is delivered to the U.S. Government or anyone licensing it on behalf of the U.S. Government, then the following notice is applicable: U.S. GOVERNMENT END USERS: Oracle programs (including any operating system, integrated software, any programs embedded, installed or activated on delivered hardware, and modifications of such programs) and Oracle computer documentation or other Oracle data delivered to or accessed by U.S.
    [Show full text]
  • Basis Technology Unicode対応ライブラリ スペックシート 文字コード その他の名称 Adobe-Standard-Encoding A
    Basis Technology Unicode対応ライブラリ スペックシート 文字コード その他の名称 Adobe-Standard-Encoding Adobe-Symbol-Encoding csHPPSMath Adobe-Zapf-Dingbats-Encoding csZapfDingbats Arabic ISO-8859-6, csISOLatinArabic, iso-ir-127, ECMA-114, ASMO-708 ASCII US-ASCII, ANSI_X3.4-1968, iso-ir-6, ANSI_X3.4-1986, ISO646-US, us, IBM367, csASCI big-endian ISO-10646-UCS-2, BigEndian, 68k, PowerPC, Mac, Macintosh Big5 csBig5, cn-big5, x-x-big5 Big5Plus Big5+, csBig5Plus BMP ISO-10646-UCS-2, BMPstring CCSID-1027 csCCSID1027, IBM1027 CCSID-1047 csCCSID1047, IBM1047 CCSID-290 csCCSID290, CCSID290, IBM290 CCSID-300 csCCSID300, CCSID300, IBM300 CCSID-930 csCCSID930, CCSID930, IBM930 CCSID-935 csCCSID935, CCSID935, IBM935 CCSID-937 csCCSID937, CCSID937, IBM937 CCSID-939 csCCSID939, CCSID939, IBM939 CCSID-942 csCCSID942, CCSID942, IBM942 ChineseAutoDetect csChineseAutoDetect: Candidate encodings: GB2312, Big5, GB18030, UTF32:UTF8, UCS2, UTF32 EUC-H, csCNS11643EUC, EUC-TW, TW-EUC, H-EUC, CNS-11643-1992, EUC-H-1992, csCNS11643-1992-EUC, EUC-TW-1992, CNS-11643 TW-EUC-1992, H-EUC-1992 CNS-11643-1986 EUC-H-1986, csCNS11643_1986_EUC, EUC-TW-1986, TW-EUC-1986, H-EUC-1986 CP10000 csCP10000, windows-10000 CP10001 csCP10001, windows-10001 CP10002 csCP10002, windows-10002 CP10003 csCP10003, windows-10003 CP10004 csCP10004, windows-10004 CP10005 csCP10005, windows-10005 CP10006 csCP10006, windows-10006 CP10007 csCP10007, windows-10007 CP10008 csCP10008, windows-10008 CP10010 csCP10010, windows-10010 CP10017 csCP10017, windows-10017 CP10029 csCP10029, windows-10029 CP10079 csCP10079, windows-10079
    [Show full text]